2023-02-09 16:53:34,979 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor timeout: 13 mins 2023-02-09 16:53:35,261 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5698638b-a3fc-8e58-7588-e5d09b0cf064 2023-02-09 16:53:35,273 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=1, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-02-09 16:53:35,274 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5698638b-a3fc-8e58-7588-e5d09b0cf064/cluster_d6b3018f-2464-05f6-c84c-1699b67fed18, deleteOnExit=true 2023-02-09 16:53:35,274 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-09 16:53:35,275 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5698638b-a3fc-8e58-7588-e5d09b0cf064/test.cache.data in system properties and HBase conf 2023-02-09 16:53:35,275 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5698638b-a3fc-8e58-7588-e5d09b0cf064/hadoop.tmp.dir in system properties and HBase conf 2023-02-09 16:53:35,275 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5698638b-a3fc-8e58-7588-e5d09b0cf064/hadoop.log.dir in system properties and HBase conf 2023-02-09 16:53:35,276 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5698638b-a3fc-8e58-7588-e5d09b0cf064/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-09 16:53:35,276 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5698638b-a3fc-8e58-7588-e5d09b0cf064/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-09 16:53:35,277 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-09 16:53:35,392 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-02-09 16:53:35,813 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-09 16:53:35,817 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5698638b-a3fc-8e58-7588-e5d09b0cf064/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-09 16:53:35,817 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5698638b-a3fc-8e58-7588-e5d09b0cf064/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-09 16:53:35,818 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5698638b-a3fc-8e58-7588-e5d09b0cf064/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-09 16:53:35,818 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5698638b-a3fc-8e58-7588-e5d09b0cf064/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-09 16:53:35,818 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5698638b-a3fc-8e58-7588-e5d09b0cf064/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-09 16:53:35,819 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5698638b-a3fc-8e58-7588-e5d09b0cf064/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-09 16:53:35,819 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5698638b-a3fc-8e58-7588-e5d09b0cf064/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-09 16:53:35,819 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5698638b-a3fc-8e58-7588-e5d09b0cf064/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-09 16:53:35,820 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5698638b-a3fc-8e58-7588-e5d09b0cf064/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-09 16:53:35,820 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5698638b-a3fc-8e58-7588-e5d09b0cf064/nfs.dump.dir in system properties and HBase conf 2023-02-09 16:53:35,821 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5698638b-a3fc-8e58-7588-e5d09b0cf064/java.io.tmpdir in system properties and HBase conf 2023-02-09 16:53:35,821 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5698638b-a3fc-8e58-7588-e5d09b0cf064/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-09 16:53:35,821 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5698638b-a3fc-8e58-7588-e5d09b0cf064/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-09 16:53:35,822 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5698638b-a3fc-8e58-7588-e5d09b0cf064/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-09 16:53:36,366 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-09 16:53:36,371 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-09 16:53:36,693 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-02-09 16:53:36,889 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-02-09 16:53:36,910 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 16:53:36,949 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 16:53:36,980 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5698638b-a3fc-8e58-7588-e5d09b0cf064/java.io.tmpdir/Jetty_localhost_42597_hdfs____gw5q4f/webapp 2023-02-09 16:53:37,146 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42597 2023-02-09 16:53:37,162 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-09 16:53:37,163 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-09 16:53:37,706 WARN [Listener at localhost/33743] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 16:53:37,769 WARN [Listener at localhost/33743] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-09 16:53:37,788 WARN [Listener at localhost/33743] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 16:53:37,794 INFO [Listener at localhost/33743] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 16:53:37,798 INFO [Listener at localhost/33743] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5698638b-a3fc-8e58-7588-e5d09b0cf064/java.io.tmpdir/Jetty_localhost_34811_datanode____160num/webapp 2023-02-09 16:53:37,899 INFO [Listener at localhost/33743] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34811 2023-02-09 16:53:38,203 WARN [Listener at localhost/41619] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 16:53:38,625 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd66c613716b52181: Processing first storage report for DS-6aaabe8a-e7a9-4090-8d83-807e892198a1 from datanode d193cb00-4901-4ddd-99d7-a366c37b7f50 2023-02-09 16:53:38,626 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd66c613716b52181: from storage DS-6aaabe8a-e7a9-4090-8d83-807e892198a1 node DatanodeRegistration(127.0.0.1:41955, datanodeUuid=d193cb00-4901-4ddd-99d7-a366c37b7f50, infoPort=44651, infoSecurePort=0, ipcPort=41619, storageInfo=lv=-57;cid=testClusterID;nsid=1942601434;c=1675961616451), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-09 16:53:38,626 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd66c613716b52181: Processing first storage report for DS-734816dd-88f1-4de7-b7f3-fc487c399478 from datanode d193cb00-4901-4ddd-99d7-a366c37b7f50 2023-02-09 16:53:38,626 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd66c613716b52181: from storage DS-734816dd-88f1-4de7-b7f3-fc487c399478 node DatanodeRegistration(127.0.0.1:41955, datanodeUuid=d193cb00-4901-4ddd-99d7-a366c37b7f50, infoPort=44651, infoSecurePort=0, ipcPort=41619, storageInfo=lv=-57;cid=testClusterID;nsid=1942601434;c=1675961616451), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 16:53:38,689 DEBUG [Listener at localhost/41619] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5698638b-a3fc-8e58-7588-e5d09b0cf064 2023-02-09 16:53:38,749 INFO [Listener at localhost/41619] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5698638b-a3fc-8e58-7588-e5d09b0cf064/cluster_d6b3018f-2464-05f6-c84c-1699b67fed18/zookeeper_0, clientPort=53887, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5698638b-a3fc-8e58-7588-e5d09b0cf064/cluster_d6b3018f-2464-05f6-c84c-1699b67fed18/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5698638b-a3fc-8e58-7588-e5d09b0cf064/cluster_d6b3018f-2464-05f6-c84c-1699b67fed18/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-09 16:53:38,762 INFO [Listener at localhost/41619] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=53887 2023-02-09 16:53:38,770 INFO [Listener at localhost/41619] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 16:53:38,772 INFO [Listener at localhost/41619] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 16:53:39,417 INFO [Listener at localhost/41619] util.FSUtils(479): Created version file at hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3 with version=8 2023-02-09 16:53:39,418 INFO [Listener at localhost/41619] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/hbase-staging 2023-02-09 16:53:39,726 INFO [Listener at localhost/41619] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-02-09 16:53:40,180 INFO [Listener at localhost/41619] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=3 2023-02-09 16:53:40,210 INFO [Listener at localhost/41619] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 16:53:40,211 INFO [Listener at localhost/41619] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 16:53:40,211 INFO [Listener at localhost/41619] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 16:53:40,211 INFO [Listener at localhost/41619] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 16:53:40,211 INFO [Listener at localhost/41619] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 16:53:40,349 INFO [Listener at localhost/41619] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 16:53:40,423 DEBUG [Listener at localhost/41619] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-02-09 16:53:40,514 INFO [Listener at localhost/41619] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41333 2023-02-09 16:53:40,524 INFO [Listener at localhost/41619] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 16:53:40,526 INFO [Listener at localhost/41619] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 16:53:40,546 INFO [Listener at localhost/41619] zookeeper.RecoverableZooKeeper(93): Process identifier=master:41333 connecting to ZooKeeper ensemble=127.0.0.1:53887 2023-02-09 16:53:40,586 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:413330x0, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 16:53:40,588 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:41333-0x1003a00baf40000 connected 2023-02-09 16:53:40,616 DEBUG [Listener at localhost/41619] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 16:53:40,617 DEBUG [Listener at localhost/41619] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 16:53:40,620 DEBUG [Listener at localhost/41619] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 16:53:40,627 DEBUG [Listener at localhost/41619] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41333 2023-02-09 16:53:40,627 DEBUG [Listener at localhost/41619] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41333 2023-02-09 16:53:40,628 DEBUG [Listener at localhost/41619] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41333 2023-02-09 16:53:40,628 DEBUG [Listener at localhost/41619] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41333 2023-02-09 16:53:40,629 DEBUG [Listener at localhost/41619] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41333 2023-02-09 16:53:40,634 INFO [Listener at localhost/41619] master.HMaster(439): hbase.rootdir=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3, hbase.cluster.distributed=false 2023-02-09 16:53:40,700 INFO [Listener at localhost/41619] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=3 2023-02-09 16:53:40,700 INFO [Listener at localhost/41619] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 16:53:40,700 INFO [Listener at localhost/41619] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 16:53:40,700 INFO [Listener at localhost/41619] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 16:53:40,700 INFO [Listener at localhost/41619] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 16:53:40,700 INFO [Listener at localhost/41619] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 16:53:40,705 INFO [Listener at localhost/41619] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 16:53:40,708 INFO [Listener at localhost/41619] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35511 2023-02-09 16:53:40,710 INFO [Listener at localhost/41619] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-09 16:53:40,715 DEBUG [Listener at localhost/41619] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 16:53:40,716 INFO [Listener at localhost/41619] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 16:53:40,719 INFO [Listener at localhost/41619] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 16:53:40,720 INFO [Listener at localhost/41619] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35511 connecting to ZooKeeper ensemble=127.0.0.1:53887 2023-02-09 16:53:40,724 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:355110x0, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 16:53:40,724 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:35511-0x1003a00baf40001 connected 2023-02-09 16:53:40,725 DEBUG [Listener at localhost/41619] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 16:53:40,726 DEBUG [Listener at localhost/41619] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 16:53:40,727 DEBUG [Listener at localhost/41619] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 16:53:40,727 DEBUG [Listener at localhost/41619] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35511 2023-02-09 16:53:40,727 DEBUG [Listener at localhost/41619] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35511 2023-02-09 16:53:40,728 DEBUG [Listener at localhost/41619] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35511 2023-02-09 16:53:40,728 DEBUG [Listener at localhost/41619] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35511 2023-02-09 16:53:40,728 DEBUG [Listener at localhost/41619] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35511 2023-02-09 16:53:40,730 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,41333,1675961619562 2023-02-09 16:53:40,741 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-09 16:53:40,742 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,41333,1675961619562 2023-02-09 16:53:40,759 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 16:53:40,759 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 16:53:40,759 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 16:53:40,760 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-09 16:53:40,761 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,41333,1675961619562 from backup master directory 2023-02-09 16:53:40,761 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-09 16:53:40,765 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,41333,1675961619562 2023-02-09 16:53:40,765 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-09 16:53:40,766 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 16:53:40,766 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,41333,1675961619562 2023-02-09 16:53:40,769 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-02-09 16:53:40,770 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-02-09 16:53:40,853 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/hbase.id with ID: 12f0d629-d03e-4136-ae6a-edd243c77b47 2023-02-09 16:53:40,892 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 16:53:40,905 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 16:53:40,943 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x4ec2e9fd to 127.0.0.1:53887 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 16:53:40,974 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5f710e3e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 16:53:40,996 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-09 16:53:40,998 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-09 16:53:41,014 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-02-09 16:53:41,015 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-02-09 16:53:41,016 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:849) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2178) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:523) at java.lang.Thread.run(Thread.java:750) 2023-02-09 16:53:41,020 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:849) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2178) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:523) at java.lang.Thread.run(Thread.java:750) 2023-02-09 16:53:41,021 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 16:53:41,052 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/MasterData/data/master/store-tmp 2023-02-09 16:53:41,478 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 16:53:41,478 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-09 16:53:41,479 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 16:53:41,479 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 16:53:41,479 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-09 16:53:41,479 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 16:53:41,479 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 16:53:41,479 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675961621478Disabling compacts and flushes for region at 1675961621478Disabling writes for close at 1675961621479 (+1 ms)Writing region close event to WAL at 1675961621479Closed at 1675961621479 2023-02-09 16:53:41,481 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/MasterData/WALs/jenkins-hbase4.apache.org,41333,1675961619562 2023-02-09 16:53:41,500 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41333%2C1675961619562, suffix=, logDir=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/MasterData/WALs/jenkins-hbase4.apache.org,41333,1675961619562, archiveDir=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/MasterData/oldWALs, maxLogs=10 2023-02-09 16:53:41,562 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41955,DS-6aaabe8a-e7a9-4090-8d83-807e892198a1,DISK] 2023-02-09 16:53:41,569 DEBUG [RS-EventLoopGroup-3-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-02-09 16:53:41,635 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/MasterData/WALs/jenkins-hbase4.apache.org,41333,1675961619562/jenkins-hbase4.apache.org%2C41333%2C1675961619562.1675961621510 2023-02-09 16:53:41,635 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41955,DS-6aaabe8a-e7a9-4090-8d83-807e892198a1,DISK]] 2023-02-09 16:53:41,636 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-09 16:53:41,637 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 16:53:41,640 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 16:53:41,641 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 16:53:41,697 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-09 16:53:41,704 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-09 16:53:41,726 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-09 16:53:41,738 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 16:53:41,743 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-09 16:53:41,745 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-09 16:53:41,760 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 16:53:41,764 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 16:53:41,765 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73204627, jitterRate=0.09083394706249237}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 16:53:41,766 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1675961621667Initializing all the Stores at 1675961621669 (+2 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675961621670 (+1 ms)Cleaning up temporary data from old regions at 1675961621753 (+83 ms)Cleaning up detritus from prior splits at 1675961621753Region opened successfully at 1675961621766 (+13 ms) 2023-02-09 16:53:41,767 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-09 16:53:41,786 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-09 16:53:41,786 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-09 16:53:41,788 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-09 16:53:41,790 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-02-09 16:53:41,821 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 30 msec 2023-02-09 16:53:41,821 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-09 16:53:41,845 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-09 16:53:41,850 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-09 16:53:41,873 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-09 16:53:41,877 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-09 16:53:41,879 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-09 16:53:41,884 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-09 16:53:41,887 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-09 16:53:41,890 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 16:53:41,891 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-09 16:53:41,892 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-09 16:53:41,903 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-09 16:53:41,908 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 16:53:41,908 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 16:53:41,908 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 16:53:41,909 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,41333,1675961619562, sessionid=0x1003a00baf40000, setting cluster-up flag (Was=false) 2023-02-09 16:53:41,922 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 16:53:41,928 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-09 16:53:41,929 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,41333,1675961619562 2023-02-09 16:53:41,934 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 16:53:41,939 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-09 16:53:41,941 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,41333,1675961619562 2023-02-09 16:53:41,943 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.hbase-snapshot/.tmp 2023-02-09 16:53:42,033 INFO [RS:0;jenkins-hbase4:35511] regionserver.HRegionServer(952): ClusterId : 12f0d629-d03e-4136-ae6a-edd243c77b47 2023-02-09 16:53:42,037 DEBUG [RS:0;jenkins-hbase4:35511] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-09 16:53:42,042 DEBUG [RS:0;jenkins-hbase4:35511] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-09 16:53:42,042 DEBUG [RS:0;jenkins-hbase4:35511] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-09 16:53:42,046 DEBUG [RS:0;jenkins-hbase4:35511] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-09 16:53:42,047 DEBUG [RS:0;jenkins-hbase4:35511] zookeeper.ReadOnlyZKClient(139): Connect 0x25774c7d to 127.0.0.1:53887 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 16:53:42,052 DEBUG [RS:0;jenkins-hbase4:35511] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2bb0a6a3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 16:53:42,052 DEBUG [RS:0;jenkins-hbase4:35511] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2f8f270d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 16:53:42,053 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-09 16:53:42,063 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 16:53:42,063 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 16:53:42,063 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 16:53:42,063 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 16:53:42,064 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-09 16:53:42,064 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 16:53:42,064 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 16:53:42,064 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 16:53:42,066 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1675961652066 2023-02-09 16:53:42,068 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-09 16:53:42,072 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-09 16:53:42,072 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-09 16:53:42,077 DEBUG [RS:0;jenkins-hbase4:35511] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:35511 2023-02-09 16:53:42,077 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-09 16:53:42,080 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-09 16:53:42,081 INFO [RS:0;jenkins-hbase4:35511] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-09 16:53:42,081 INFO [RS:0;jenkins-hbase4:35511] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-09 16:53:42,081 DEBUG [RS:0;jenkins-hbase4:35511] regionserver.HRegionServer(1023): About to register with Master. 2023-02-09 16:53:42,084 INFO [RS:0;jenkins-hbase4:35511] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,41333,1675961619562 with isa=jenkins-hbase4.apache.org/172.31.14.131:35511, startcode=1675961620699 2023-02-09 16:53:42,089 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-09 16:53:42,089 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-09 16:53:42,090 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-09 16:53:42,090 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-09 16:53:42,090 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-09 16:53:42,092 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-09 16:53:42,094 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-09 16:53:42,094 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-09 16:53:42,097 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-09 16:53:42,097 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-09 16:53:42,101 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675961622101,5,FailOnTimeoutGroup] 2023-02-09 16:53:42,102 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675961622102,5,FailOnTimeoutGroup] 2023-02-09 16:53:42,102 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-09 16:53:42,103 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-09 16:53:42,105 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-09 16:53:42,105 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-09 16:53:42,108 DEBUG [RS:0;jenkins-hbase4:35511] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-09 16:53:42,156 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44361, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-02-09 16:53:42,166 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:42,181 DEBUG [RS:0;jenkins-hbase4:35511] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3 2023-02-09 16:53:42,181 DEBUG [RS:0;jenkins-hbase4:35511] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:33743 2023-02-09 16:53:42,181 DEBUG [RS:0;jenkins-hbase4:35511] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-09 16:53:42,186 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 16:53:42,187 DEBUG [RS:0;jenkins-hbase4:35511] zookeeper.ZKUtil(162): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:42,187 WARN [RS:0;jenkins-hbase4:35511] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 16:53:42,188 INFO [RS:0;jenkins-hbase4:35511] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 16:53:42,188 DEBUG [RS:0;jenkins-hbase4:35511] regionserver.HRegionServer(1947): logDir=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/WALs/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:42,189 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,35511,1675961620699] 2023-02-09 16:53:42,197 DEBUG [RS:0;jenkins-hbase4:35511] zookeeper.ZKUtil(162): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:42,207 DEBUG [RS:0;jenkins-hbase4:35511] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-09 16:53:42,215 INFO [RS:0;jenkins-hbase4:35511] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-09 16:53:42,233 INFO [RS:0;jenkins-hbase4:35511] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-09 16:53:42,236 INFO [RS:0;jenkins-hbase4:35511] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 16:53:42,236 INFO [RS:0;jenkins-hbase4:35511] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 16:53:42,237 INFO [RS:0;jenkins-hbase4:35511] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-09 16:53:42,244 INFO [RS:0;jenkins-hbase4:35511] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=100, unit=MILLISECONDS is enabled. 2023-02-09 16:53:42,244 DEBUG [RS:0;jenkins-hbase4:35511] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 16:53:42,245 DEBUG [RS:0;jenkins-hbase4:35511] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 16:53:42,245 DEBUG [RS:0;jenkins-hbase4:35511] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 16:53:42,245 DEBUG [RS:0;jenkins-hbase4:35511] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 16:53:42,245 DEBUG [RS:0;jenkins-hbase4:35511] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 16:53:42,245 DEBUG [RS:0;jenkins-hbase4:35511] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 16:53:42,245 DEBUG [RS:0;jenkins-hbase4:35511] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 16:53:42,245 DEBUG [RS:0;jenkins-hbase4:35511] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 16:53:42,245 DEBUG [RS:0;jenkins-hbase4:35511] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 16:53:42,246 DEBUG [RS:0;jenkins-hbase4:35511] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 16:53:42,246 INFO [RS:0;jenkins-hbase4:35511] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 16:53:42,247 INFO [RS:0;jenkins-hbase4:35511] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 16:53:42,247 INFO [RS:0;jenkins-hbase4:35511] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-09 16:53:42,261 INFO [RS:0;jenkins-hbase4:35511] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-09 16:53:42,264 INFO [RS:0;jenkins-hbase4:35511] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35511,1675961620699-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 16:53:42,279 INFO [RS:0;jenkins-hbase4:35511] regionserver.Replication(203): jenkins-hbase4.apache.org,35511,1675961620699 started 2023-02-09 16:53:42,279 INFO [RS:0;jenkins-hbase4:35511] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,35511,1675961620699, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:35511, sessionid=0x1003a00baf40001 2023-02-09 16:53:42,279 DEBUG [RS:0;jenkins-hbase4:35511] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-09 16:53:42,279 DEBUG [RS:0;jenkins-hbase4:35511] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:42,279 DEBUG [RS:0;jenkins-hbase4:35511] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35511,1675961620699' 2023-02-09 16:53:42,279 DEBUG [RS:0;jenkins-hbase4:35511] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:53:42,280 DEBUG [RS:0;jenkins-hbase4:35511] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:53:42,280 DEBUG [RS:0;jenkins-hbase4:35511] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-09 16:53:42,280 DEBUG [RS:0;jenkins-hbase4:35511] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-09 16:53:42,280 DEBUG [RS:0;jenkins-hbase4:35511] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:42,281 DEBUG [RS:0;jenkins-hbase4:35511] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35511,1675961620699' 2023-02-09 16:53:42,281 DEBUG [RS:0;jenkins-hbase4:35511] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 16:53:42,281 DEBUG [RS:0;jenkins-hbase4:35511] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 16:53:42,281 DEBUG [RS:0;jenkins-hbase4:35511] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-09 16:53:42,281 INFO [RS:0;jenkins-hbase4:35511] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-09 16:53:42,282 INFO [RS:0;jenkins-hbase4:35511] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-09 16:53:42,392 INFO [RS:0;jenkins-hbase4:35511] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35511%2C1675961620699, suffix=, logDir=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/WALs/jenkins-hbase4.apache.org,35511,1675961620699, archiveDir=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/oldWALs, maxLogs=32 2023-02-09 16:53:42,410 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41955,DS-6aaabe8a-e7a9-4090-8d83-807e892198a1,DISK] 2023-02-09 16:53:42,413 INFO [RS:0;jenkins-hbase4:35511] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/WALs/jenkins-hbase4.apache.org,35511,1675961620699/jenkins-hbase4.apache.org%2C35511%2C1675961620699.1675961622394 2023-02-09 16:53:42,413 DEBUG [RS:0;jenkins-hbase4:35511] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41955,DS-6aaabe8a-e7a9-4090-8d83-807e892198a1,DISK]] 2023-02-09 16:53:42,509 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-09 16:53:42,510 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-09 16:53:42,511 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3 2023-02-09 16:53:42,924 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 16:53:42,926 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-09 16:53:42,929 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/hbase/meta/1588230740/info 2023-02-09 16:53:42,930 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-09 16:53:42,931 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 16:53:42,931 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-09 16:53:42,933 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/hbase/meta/1588230740/rep_barrier 2023-02-09 16:53:42,934 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-09 16:53:42,935 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 16:53:42,935 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-09 16:53:42,937 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/hbase/meta/1588230740/table 2023-02-09 16:53:42,938 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-09 16:53:42,938 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 16:53:42,940 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/hbase/meta/1588230740 2023-02-09 16:53:42,940 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/hbase/meta/1588230740 2023-02-09 16:53:42,945 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-09 16:53:42,946 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-09 16:53:42,950 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 16:53:42,951 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72064208, jitterRate=0.07384037971496582}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-09 16:53:42,951 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1675961622924Initializing all the Stores at 1675961622925 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675961622926 (+1 ms)Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675961622926Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675961622926Cleaning up temporary data from old regions at 1675961622942 (+16 ms)Cleaning up detritus from prior splits at 1675961622943 (+1 ms)Region opened successfully at 1675961622951 (+8 ms) 2023-02-09 16:53:42,952 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-09 16:53:42,952 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-09 16:53:42,952 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-09 16:53:42,952 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-09 16:53:42,952 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-09 16:53:42,953 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-09 16:53:42,953 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675961622952Disabling compacts and flushes for region at 1675961622952Disabling writes for close at 1675961622952Writing region close event to WAL at 1675961622953 (+1 ms)Closed at 1675961622953 2023-02-09 16:53:42,957 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-09 16:53:42,957 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-09 16:53:42,965 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-09 16:53:42,976 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-09 16:53:42,978 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-09 16:53:43,130 DEBUG [jenkins-hbase4:41333] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-02-09 16:53:43,133 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,35511,1675961620699, state=OPENING 2023-02-09 16:53:43,140 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-09 16:53:43,142 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 16:53:43,143 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-09 16:53:43,145 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,35511,1675961620699}] 2023-02-09 16:53:43,328 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:43,330 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-09 16:53:43,334 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35712, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-09 16:53:43,345 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-09 16:53:43,345 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 16:53:43,349 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35511%2C1675961620699.meta, suffix=.meta, logDir=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/WALs/jenkins-hbase4.apache.org,35511,1675961620699, archiveDir=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/oldWALs, maxLogs=32 2023-02-09 16:53:43,365 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41955,DS-6aaabe8a-e7a9-4090-8d83-807e892198a1,DISK] 2023-02-09 16:53:43,371 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/WALs/jenkins-hbase4.apache.org,35511,1675961620699/jenkins-hbase4.apache.org%2C35511%2C1675961620699.meta.1675961623350.meta 2023-02-09 16:53:43,371 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41955,DS-6aaabe8a-e7a9-4090-8d83-807e892198a1,DISK]] 2023-02-09 16:53:43,371 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-09 16:53:43,373 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-09 16:53:43,393 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-09 16:53:43,398 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-09 16:53:43,404 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-09 16:53:43,404 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 16:53:43,404 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-09 16:53:43,404 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-09 16:53:43,407 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-09 16:53:43,408 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/hbase/meta/1588230740/info 2023-02-09 16:53:43,408 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/hbase/meta/1588230740/info 2023-02-09 16:53:43,409 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-09 16:53:43,410 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 16:53:43,410 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-09 16:53:43,412 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/hbase/meta/1588230740/rep_barrier 2023-02-09 16:53:43,412 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/hbase/meta/1588230740/rep_barrier 2023-02-09 16:53:43,412 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-09 16:53:43,413 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 16:53:43,413 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-09 16:53:43,415 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/hbase/meta/1588230740/table 2023-02-09 16:53:43,415 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/hbase/meta/1588230740/table 2023-02-09 16:53:43,415 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-09 16:53:43,416 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 16:53:43,418 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/hbase/meta/1588230740 2023-02-09 16:53:43,420 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/hbase/meta/1588230740 2023-02-09 16:53:43,423 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-09 16:53:43,425 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-09 16:53:43,426 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62986629, jitterRate=-0.06142608821392059}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-09 16:53:43,427 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1675961623404Writing region info on filesystem at 1675961623405 (+1 ms)Initializing all the Stores at 1675961623406 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675961623406Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675961623406Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675961623406Cleaning up temporary data from old regions at 1675961623421 (+15 ms)Cleaning up detritus from prior splits at 1675961623422 (+1 ms)Running coprocessor post-open hooks at 1675961623426 (+4 ms)Region opened successfully at 1675961623427 (+1 ms) 2023-02-09 16:53:43,435 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1675961623321 2023-02-09 16:53:43,452 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-09 16:53:43,453 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-09 16:53:43,453 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,35511,1675961620699, state=OPEN 2023-02-09 16:53:43,456 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-09 16:53:43,456 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-09 16:53:43,460 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-09 16:53:43,460 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,35511,1675961620699 in 311 msec 2023-02-09 16:53:43,465 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-09 16:53:43,465 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 496 msec 2023-02-09 16:53:43,470 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.4830 sec 2023-02-09 16:53:43,470 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1675961620755, completionTime=-1 2023-02-09 16:53:43,471 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-02-09 16:53:43,471 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-09 16:53:43,529 DEBUG [hconnection-0x263a2993-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 16:53:43,533 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33616, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 16:53:43,549 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=1 2023-02-09 16:53:43,549 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1675961683549 2023-02-09 16:53:43,549 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1675961743549 2023-02-09 16:53:43,549 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 77 msec 2023-02-09 16:53:43,572 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41333,1675961619562-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 16:53:43,573 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41333,1675961619562-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 16:53:43,573 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41333,1675961619562-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 16:53:43,575 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:41333, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 16:53:43,575 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-09 16:53:43,581 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-09 16:53:43,589 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-09 16:53:43,590 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-09 16:53:43,599 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-09 16:53:43,601 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 16:53:43,603 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 16:53:43,625 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/hbase/namespace/95c60abda4725d3b35fe074fbbf00f8f 2023-02-09 16:53:43,627 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/hbase/namespace/95c60abda4725d3b35fe074fbbf00f8f empty. 2023-02-09 16:53:43,628 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/hbase/namespace/95c60abda4725d3b35fe074fbbf00f8f 2023-02-09 16:53:43,628 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-09 16:53:44,050 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-09 16:53:44,053 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 95c60abda4725d3b35fe074fbbf00f8f, NAME => 'hbase:namespace,,1675961623590.95c60abda4725d3b35fe074fbbf00f8f.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp 2023-02-09 16:53:44,465 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675961623590.95c60abda4725d3b35fe074fbbf00f8f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 16:53:44,465 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 95c60abda4725d3b35fe074fbbf00f8f, disabling compactions & flushes 2023-02-09 16:53:44,465 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675961623590.95c60abda4725d3b35fe074fbbf00f8f. 2023-02-09 16:53:44,465 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675961623590.95c60abda4725d3b35fe074fbbf00f8f. 2023-02-09 16:53:44,465 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675961623590.95c60abda4725d3b35fe074fbbf00f8f. after waiting 0 ms 2023-02-09 16:53:44,465 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675961623590.95c60abda4725d3b35fe074fbbf00f8f. 2023-02-09 16:53:44,465 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675961623590.95c60abda4725d3b35fe074fbbf00f8f. 2023-02-09 16:53:44,465 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 95c60abda4725d3b35fe074fbbf00f8f: Waiting for close lock at 1675961624465Disabling compacts and flushes for region at 1675961624465Disabling writes for close at 1675961624465Writing region close event to WAL at 1675961624465Closed at 1675961624465 2023-02-09 16:53:44,470 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 16:53:44,485 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1675961623590.95c60abda4725d3b35fe074fbbf00f8f.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675961624473"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675961624473"}]},"ts":"1675961624473"} 2023-02-09 16:53:44,510 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-09 16:53:44,512 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 16:53:44,516 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675961624512"}]},"ts":"1675961624512"} 2023-02-09 16:53:44,519 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-09 16:53:44,529 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=95c60abda4725d3b35fe074fbbf00f8f, ASSIGN}] 2023-02-09 16:53:44,531 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=95c60abda4725d3b35fe074fbbf00f8f, ASSIGN 2023-02-09 16:53:44,533 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=95c60abda4725d3b35fe074fbbf00f8f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35511,1675961620699; forceNewPlan=false, retain=false 2023-02-09 16:53:44,684 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=95c60abda4725d3b35fe074fbbf00f8f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:44,684 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1675961623590.95c60abda4725d3b35fe074fbbf00f8f.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675961624684"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675961624684"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675961624684"}]},"ts":"1675961624684"} 2023-02-09 16:53:44,688 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 95c60abda4725d3b35fe074fbbf00f8f, server=jenkins-hbase4.apache.org,35511,1675961620699}] 2023-02-09 16:53:44,848 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1675961623590.95c60abda4725d3b35fe074fbbf00f8f. 2023-02-09 16:53:44,849 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 95c60abda4725d3b35fe074fbbf00f8f, NAME => 'hbase:namespace,,1675961623590.95c60abda4725d3b35fe074fbbf00f8f.', STARTKEY => '', ENDKEY => ''} 2023-02-09 16:53:44,849 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 95c60abda4725d3b35fe074fbbf00f8f 2023-02-09 16:53:44,849 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675961623590.95c60abda4725d3b35fe074fbbf00f8f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 16:53:44,849 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 95c60abda4725d3b35fe074fbbf00f8f 2023-02-09 16:53:44,850 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 95c60abda4725d3b35fe074fbbf00f8f 2023-02-09 16:53:44,851 INFO [StoreOpener-95c60abda4725d3b35fe074fbbf00f8f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 95c60abda4725d3b35fe074fbbf00f8f 2023-02-09 16:53:44,854 DEBUG [StoreOpener-95c60abda4725d3b35fe074fbbf00f8f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/hbase/namespace/95c60abda4725d3b35fe074fbbf00f8f/info 2023-02-09 16:53:44,854 DEBUG [StoreOpener-95c60abda4725d3b35fe074fbbf00f8f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/hbase/namespace/95c60abda4725d3b35fe074fbbf00f8f/info 2023-02-09 16:53:44,854 INFO [StoreOpener-95c60abda4725d3b35fe074fbbf00f8f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 95c60abda4725d3b35fe074fbbf00f8f columnFamilyName info 2023-02-09 16:53:44,855 INFO [StoreOpener-95c60abda4725d3b35fe074fbbf00f8f-1] regionserver.HStore(310): Store=95c60abda4725d3b35fe074fbbf00f8f/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 16:53:44,857 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/hbase/namespace/95c60abda4725d3b35fe074fbbf00f8f 2023-02-09 16:53:44,857 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/hbase/namespace/95c60abda4725d3b35fe074fbbf00f8f 2023-02-09 16:53:44,862 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 95c60abda4725d3b35fe074fbbf00f8f 2023-02-09 16:53:44,865 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/hbase/namespace/95c60abda4725d3b35fe074fbbf00f8f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 16:53:44,866 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 95c60abda4725d3b35fe074fbbf00f8f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73403025, jitterRate=0.09379030764102936}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 16:53:44,866 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 95c60abda4725d3b35fe074fbbf00f8f: Running coprocessor pre-open hook at 1675961624850Writing region info on filesystem at 1675961624850Initializing all the Stores at 1675961624851 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675961624851Cleaning up temporary data from old regions at 1675961624858 (+7 ms)Cleaning up detritus from prior splits at 1675961624859 (+1 ms)Running coprocessor post-open hooks at 1675961624866 (+7 ms)Region opened successfully at 1675961624866 2023-02-09 16:53:44,868 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1675961623590.95c60abda4725d3b35fe074fbbf00f8f., pid=6, masterSystemTime=1675961624842 2023-02-09 16:53:44,872 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1675961623590.95c60abda4725d3b35fe074fbbf00f8f. 2023-02-09 16:53:44,872 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1675961623590.95c60abda4725d3b35fe074fbbf00f8f. 2023-02-09 16:53:44,873 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=95c60abda4725d3b35fe074fbbf00f8f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:44,874 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1675961623590.95c60abda4725d3b35fe074fbbf00f8f.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675961624873"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675961624873"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675961624873"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675961624873"}]},"ts":"1675961624873"} 2023-02-09 16:53:44,880 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-09 16:53:44,880 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 95c60abda4725d3b35fe074fbbf00f8f, server=jenkins-hbase4.apache.org,35511,1675961620699 in 189 msec 2023-02-09 16:53:44,883 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-09 16:53:44,884 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=95c60abda4725d3b35fe074fbbf00f8f, ASSIGN in 351 msec 2023-02-09 16:53:44,885 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 16:53:44,885 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675961624885"}]},"ts":"1675961624885"} 2023-02-09 16:53:44,888 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-09 16:53:44,892 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 16:53:44,894 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 1.3010 sec 2023-02-09 16:53:44,902 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-09 16:53:44,903 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-09 16:53:44,903 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 16:53:44,940 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-09 16:53:44,953 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-09 16:53:44,959 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 26 msec 2023-02-09 16:53:44,962 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-09 16:53:44,972 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-09 16:53:44,977 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 14 msec 2023-02-09 16:53:44,990 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-09 16:53:44,993 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-09 16:53:44,993 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 4.227sec 2023-02-09 16:53:44,994 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-09 16:53:44,996 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-09 16:53:44,996 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-09 16:53:44,997 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41333,1675961619562-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-09 16:53:44,998 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41333,1675961619562-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-09 16:53:45,008 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-09 16:53:45,039 DEBUG [Listener at localhost/41619] zookeeper.ReadOnlyZKClient(139): Connect 0x6decc8b7 to 127.0.0.1:53887 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 16:53:45,044 DEBUG [Listener at localhost/41619] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@515b7931, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 16:53:45,056 DEBUG [hconnection-0x1b386a6b-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 16:53:45,067 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33624, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 16:53:45,076 INFO [Listener at localhost/41619] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,41333,1675961619562 2023-02-09 16:53:45,077 DEBUG [Listener at localhost/41619] zookeeper.ReadOnlyZKClient(139): Connect 0x06140021 to 127.0.0.1:53887 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 16:53:45,083 DEBUG [Listener at localhost/41619] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4e2f2d5d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 16:53:45,084 INFO [Listener at localhost/41619] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 16:53:45,104 INFO [Listener at localhost/41619] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=211, OpenFileDescriptor=475, MaxFileDescriptor=60000, SystemLoadAverage=340, ProcessCount=168, AvailableMemoryMB=4039 2023-02-09 16:53:45,108 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:53:45,108 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:53:45,115 DEBUG [Listener at localhost/41619] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-09 16:53:45,118 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39284, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-09 16:53:45,131 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-09 16:53:45,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:45,135 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 16:53:45,136 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 16:53:45,139 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthly" procId is: 9 2023-02-09 16:53:45,139 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f 2023-02-09 16:53:45,140 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f empty. 2023-02-09 16:53:45,142 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f 2023-02-09 16:53:45,142 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthly regions 2023-02-09 16:53:45,146 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:53:45,146 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:53:45,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-09 16:53:45,253 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:53:45,253 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:53:45,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-09 16:53:45,455 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:53:45,455 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:53:45,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-09 16:53:45,558 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-02-09 16:53:45,560 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(7671): creating {ENCODED => e502a6fdf571512dee7d1db9a16a0c2f, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1675961625127.e502a6fdf571512dee7d1db9a16a0c2f.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp 2023-02-09 16:53:45,757 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:53:45,757 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:53:45,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-09 16:53:45,974 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1675961625127.e502a6fdf571512dee7d1db9a16a0c2f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 16:53:45,974 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1603): Closing e502a6fdf571512dee7d1db9a16a0c2f, disabling compactions & flushes 2023-02-09 16:53:45,974 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1675961625127.e502a6fdf571512dee7d1db9a16a0c2f. 2023-02-09 16:53:45,974 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1675961625127.e502a6fdf571512dee7d1db9a16a0c2f. 2023-02-09 16:53:45,975 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1675961625127.e502a6fdf571512dee7d1db9a16a0c2f. after waiting 0 ms 2023-02-09 16:53:45,975 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1675961625127.e502a6fdf571512dee7d1db9a16a0c2f. 2023-02-09 16:53:45,975 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1675961625127.e502a6fdf571512dee7d1db9a16a0c2f. 2023-02-09 16:53:45,975 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1557): Region close journal for e502a6fdf571512dee7d1db9a16a0c2f: Waiting for close lock at 1675961625974Disabling compacts and flushes for region at 1675961625974Disabling writes for close at 1675961625975 (+1 ms)Writing region close event to WAL at 1675961625975Closed at 1675961625975 2023-02-09 16:53:45,981 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 16:53:45,983 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1675961625127.e502a6fdf571512dee7d1db9a16a0c2f.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1675961625982"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675961625982"}]},"ts":"1675961625982"} 2023-02-09 16:53:45,987 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-09 16:53:45,989 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 16:53:45,989 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675961625989"}]},"ts":"1675961625989"} 2023-02-09 16:53:45,992 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLING in hbase:meta 2023-02-09 16:53:45,997 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=e502a6fdf571512dee7d1db9a16a0c2f, ASSIGN}] 2023-02-09 16:53:45,999 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=e502a6fdf571512dee7d1db9a16a0c2f, ASSIGN 2023-02-09 16:53:46,006 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=e502a6fdf571512dee7d1db9a16a0c2f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35511,1675961620699; forceNewPlan=false, retain=false 2023-02-09 16:53:46,158 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=e502a6fdf571512dee7d1db9a16a0c2f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:46,158 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1675961625127.e502a6fdf571512dee7d1db9a16a0c2f.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1675961626158"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675961626158"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675961626158"}]},"ts":"1675961626158"} 2023-02-09 16:53:46,161 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure e502a6fdf571512dee7d1db9a16a0c2f, server=jenkins-hbase4.apache.org,35511,1675961620699}] 2023-02-09 16:53:46,260 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:53:46,260 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:53:46,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-09 16:53:46,321 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1675961625127.e502a6fdf571512dee7d1db9a16a0c2f. 2023-02-09 16:53:46,321 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e502a6fdf571512dee7d1db9a16a0c2f, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1675961625127.e502a6fdf571512dee7d1db9a16a0c2f.', STARTKEY => '', ENDKEY => ''} 2023-02-09 16:53:46,322 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly e502a6fdf571512dee7d1db9a16a0c2f 2023-02-09 16:53:46,322 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1675961625127.e502a6fdf571512dee7d1db9a16a0c2f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 16:53:46,322 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for e502a6fdf571512dee7d1db9a16a0c2f 2023-02-09 16:53:46,322 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for e502a6fdf571512dee7d1db9a16a0c2f 2023-02-09 16:53:46,326 INFO [StoreOpener-e502a6fdf571512dee7d1db9a16a0c2f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region e502a6fdf571512dee7d1db9a16a0c2f 2023-02-09 16:53:46,331 DEBUG [StoreOpener-e502a6fdf571512dee7d1db9a16a0c2f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1 2023-02-09 16:53:46,331 DEBUG [StoreOpener-e502a6fdf571512dee7d1db9a16a0c2f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1 2023-02-09 16:53:46,335 INFO [StoreOpener-e502a6fdf571512dee7d1db9a16a0c2f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e502a6fdf571512dee7d1db9a16a0c2f columnFamilyName family1 2023-02-09 16:53:46,338 INFO [StoreOpener-e502a6fdf571512dee7d1db9a16a0c2f-1] regionserver.HStore(310): Store=e502a6fdf571512dee7d1db9a16a0c2f/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 16:53:46,341 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f 2023-02-09 16:53:46,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f 2023-02-09 16:53:46,348 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for e502a6fdf571512dee7d1db9a16a0c2f 2023-02-09 16:53:46,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 16:53:46,352 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened e502a6fdf571512dee7d1db9a16a0c2f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66298912, jitterRate=-0.012069225311279297}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 16:53:46,352 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for e502a6fdf571512dee7d1db9a16a0c2f: Running coprocessor pre-open hook at 1675961626322Writing region info on filesystem at 1675961626322Initializing all the Stores at 1675961626324 (+2 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1675961626324Cleaning up temporary data from old regions at 1675961626343 (+19 ms)Cleaning up detritus from prior splits at 1675961626344 (+1 ms)Running coprocessor post-open hooks at 1675961626352 (+8 ms)Region opened successfully at 1675961626352 2023-02-09 16:53:46,354 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1675961625127.e502a6fdf571512dee7d1db9a16a0c2f., pid=11, masterSystemTime=1675961626315 2023-02-09 16:53:46,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1675961625127.e502a6fdf571512dee7d1db9a16a0c2f. 2023-02-09 16:53:46,359 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1675961625127.e502a6fdf571512dee7d1db9a16a0c2f. 2023-02-09 16:53:46,360 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=e502a6fdf571512dee7d1db9a16a0c2f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:46,361 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1675961625127.e502a6fdf571512dee7d1db9a16a0c2f.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1675961626360"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675961626360"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675961626360"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675961626360"}]},"ts":"1675961626360"} 2023-02-09 16:53:46,367 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-09 16:53:46,367 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure e502a6fdf571512dee7d1db9a16a0c2f, server=jenkins-hbase4.apache.org,35511,1675961620699 in 203 msec 2023-02-09 16:53:46,371 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-02-09 16:53:46,371 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=e502a6fdf571512dee7d1db9a16a0c2f, ASSIGN in 370 msec 2023-02-09 16:53:46,373 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 16:53:46,374 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675961626373"}]},"ts":"1675961626373"} 2023-02-09 16:53:46,376 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLED in hbase:meta 2023-02-09 16:53:46,379 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 16:53:46,382 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 1.2480 sec 2023-02-09 16:53:47,262 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:53:47,263 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:53:47,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-09 16:53:47,266 INFO [Listener at localhost/41619] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthly, procId: 9 completed 2023-02-09 16:53:47,288 DEBUG [hconnection-0x3951a133-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 16:53:47,291 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33640, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 16:53:47,454 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:53:47,454 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:53:47,457 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:53:47,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:47,467 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-09 16:53:47,467 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:53:47,468 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-09 16:53:47,468 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-09 16:53:47,469 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:47,469 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:47,471 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:53:47,471 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:47,471 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:53:47,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:53:47,472 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:47,472 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:53:47,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:47,473 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:47,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:53:47,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:47,474 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:47,476 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:47,479 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-09 16:53:47,479 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:53:47,479 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-09 16:53:47,480 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 16:53:47,480 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:53:47,480 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675961625127.e502a6fdf571512dee7d1db9a16a0c2f. 2023-02-09 16:53:47,482 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1675961625127.e502a6fdf571512dee7d1db9a16a0c2f. started... 2023-02-09 16:53:47,483 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e502a6fdf571512dee7d1db9a16a0c2f 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-09 16:53:48,055 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130b996a79ab4774a1782f34375de9895a3 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130b996a79ab4774a1782f34375de9895a3 2023-02-09 16:53:48,213 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-09 16:53:48,216 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-09 16:53:48,218 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-09 16:53:48,476 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/.tmp/family1/c1d882d6610143c1929e108bbe0b5261 2023-02-09 16:53:48,491 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/.tmp/family1/c1d882d6610143c1929e108bbe0b5261 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/c1d882d6610143c1929e108bbe0b5261 2023-02-09 16:53:48,507 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/c1d882d6610143c1929e108bbe0b5261, entries=1000, sequenceid=5, filesize=175.8 K 2023-02-09 16:53:48,510 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for e502a6fdf571512dee7d1db9a16a0c2f in 1027ms, sequenceid=5, compaction requested=false 2023-02-09 16:53:48,512 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e502a6fdf571512dee7d1db9a16a0c2f: 2023-02-09 16:53:48,512 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675961625127.e502a6fdf571512dee7d1db9a16a0c2f. 2023-02-09 16:53:48,512 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 16:53:48,512 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 16:53:48,512 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:48,512 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-09 16:53:48,513 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-09 16:53:48,515 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:48,515 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:48,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:48,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:53:48,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:53:48,516 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:48,516 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:53:48,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:53:48,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:53:48,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:48,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:48,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:53:48,518 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-09 16:53:48,518 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-09 16:53:48,518 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5a2a28a6[Count = 0] remaining members to acquire global barrier 2023-02-09 16:53:48,519 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:48,520 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:48,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:48,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:48,521 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-09 16:53:48,521 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-09 16:53:48,521 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:53:48,521 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:48,521 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:53:48,523 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:48,523 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-09 16:53:48,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:48,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:53:48,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:53:48,524 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:53:48,524 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-09 16:53:48,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:53:48,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:53:48,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:48,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:48,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:53:48,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:48,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:48,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:53:48,529 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-09 16:53:48,529 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-09 16:53:48,529 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:53:48,529 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:53:48,529 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:48,529 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:53:48,533 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:48,533 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:48,533 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:53:48,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:48,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:48,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:53:48,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:53:48,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:48,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:53:48,534 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:48,534 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:53:48,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:53:48,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:48,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:48,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:53:48,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:48,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:48,536 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:48,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:53:48,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:48,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:48,544 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:48,544 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:53:48,545 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:53:48,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:53:48,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:53:48,545 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-09 16:53:48,544 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:48,545 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:53:48,545 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:53:48,545 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:48,545 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:48,545 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:48,545 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:48,545 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:48,547 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-09 16:53:48,547 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:53:48,547 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:53:48,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:53:48,647 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:53:48,648 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:53:48,648 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:53:48,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:53:48,664 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:53:48,665 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:53:48,666 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:53:48,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-09 16:53:48,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:48,670 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-09 16:53:48,670 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:53:48,670 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-09 16:53:48,670 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-09 16:53:48,671 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:48,671 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:48,672 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:53:48,673 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:48,673 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:53:48,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:53:48,673 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:48,673 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:53:48,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:48,674 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:48,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:53:48,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:48,675 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:48,675 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-09 16:53:48,675 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:48,675 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-09 16:53:48,675 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:53:48,676 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-09 16:53:48,676 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 16:53:48,676 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:53:48,676 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675961625127.e502a6fdf571512dee7d1db9a16a0c2f. 2023-02-09 16:53:48,676 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1675961625127.e502a6fdf571512dee7d1db9a16a0c2f. started... 2023-02-09 16:53:48,676 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e502a6fdf571512dee7d1db9a16a0c2f 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-09 16:53:48,929 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-09 16:53:49,108 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112804de881d33f246fcbf4fc0adc9ea76df to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112804de881d33f246fcbf4fc0adc9ea76df 2023-02-09 16:53:49,120 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/.tmp/family1/db8dd8b51a22488bb430cc4c9b0df89f 2023-02-09 16:53:49,128 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/.tmp/family1/db8dd8b51a22488bb430cc4c9b0df89f as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/db8dd8b51a22488bb430cc4c9b0df89f 2023-02-09 16:53:49,136 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/db8dd8b51a22488bb430cc4c9b0df89f, entries=1, sequenceid=9, filesize=5.0 K 2023-02-09 16:53:49,137 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for e502a6fdf571512dee7d1db9a16a0c2f in 461ms, sequenceid=9, compaction requested=false 2023-02-09 16:53:49,137 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e502a6fdf571512dee7d1db9a16a0c2f: 2023-02-09 16:53:49,137 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675961625127.e502a6fdf571512dee7d1db9a16a0c2f. 2023-02-09 16:53:49,137 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 16:53:49,138 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 16:53:49,138 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:49,138 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-09 16:53:49,138 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-09 16:53:49,140 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:49,140 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:49,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:49,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:53:49,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:53:49,141 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:49,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:53:49,141 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:53:49,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:53:49,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:49,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:49,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:53:49,143 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-09 16:53:49,143 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2f7e5648[Count = 0] remaining members to acquire global barrier 2023-02-09 16:53:49,143 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-09 16:53:49,143 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:49,145 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:49,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:49,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:49,146 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-09 16:53:49,146 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-09 16:53:49,146 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:53:49,146 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:49,146 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:53:49,148 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-09 16:53:49,148 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:49,148 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:53:49,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:49,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:53:49,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:53:49,148 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-09 16:53:49,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:53:49,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:53:49,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:49,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:49,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:53:49,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:49,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:49,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:53:49,152 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-09 16:53:49,152 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-09 16:53:49,152 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:53:49,152 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:53:49,152 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:49,152 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:53:49,161 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:49,161 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:49,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:49,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:53:49,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:53:49,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:49,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:49,161 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:53:49,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:53:49,162 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:53:49,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:53:49,162 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:49,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:49,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:49,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:53:49,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:49,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:49,163 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:49,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:53:49,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:49,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:49,168 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:49,169 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:49,169 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:53:49,169 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:49,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:53:49,169 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-09 16:53:49,169 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:53:49,169 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:49,169 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:53:49,169 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:53:49,169 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:49,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:53:49,169 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:49,170 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:49,170 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-09 16:53:49,170 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:53:49,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:53:49,170 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:53:49,270 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:53:49,270 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:53:49,271 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:53:49,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:53:49,279 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:53:49,280 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:53:49,280 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:53:49,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-09 16:53:49,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:49,283 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-09 16:53:49,283 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:53:49,284 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-09 16:53:49,284 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-09 16:53:49,284 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:49,284 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:49,286 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:49,286 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:53:49,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:53:49,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:53:49,286 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:49,286 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:53:49,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:49,287 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:49,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:53:49,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:49,288 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:49,288 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-09 16:53:49,288 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:49,288 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-09 16:53:49,288 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:53:49,288 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-09 16:53:49,289 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 16:53:49,289 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:53:49,289 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675961625127.e502a6fdf571512dee7d1db9a16a0c2f. 2023-02-09 16:53:49,289 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1675961625127.e502a6fdf571512dee7d1db9a16a0c2f. started... 2023-02-09 16:53:49,289 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e502a6fdf571512dee7d1db9a16a0c2f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 16:53:49,716 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201600cd91bc03c4883ac92ecfef877acbc to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201600cd91bc03c4883ac92ecfef877acbc 2023-02-09 16:53:49,720 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-09 16:53:49,720 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-02-09 16:53:50,131 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/.tmp/family1/6051a2ebe2a24f799971c7d73c0c892b 2023-02-09 16:53:50,141 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/.tmp/family1/6051a2ebe2a24f799971c7d73c0c892b as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/6051a2ebe2a24f799971c7d73c0c892b 2023-02-09 16:53:50,149 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/6051a2ebe2a24f799971c7d73c0c892b, entries=1, sequenceid=13, filesize=5.0 K 2023-02-09 16:53:50,150 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e502a6fdf571512dee7d1db9a16a0c2f in 861ms, sequenceid=13, compaction requested=true 2023-02-09 16:53:50,150 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e502a6fdf571512dee7d1db9a16a0c2f: 2023-02-09 16:53:50,150 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675961625127.e502a6fdf571512dee7d1db9a16a0c2f. 2023-02-09 16:53:50,150 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 16:53:50,151 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 16:53:50,151 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:50,151 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-09 16:53:50,151 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-09 16:53:50,153 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:50,153 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:50,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:50,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:53:50,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:53:50,154 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:50,154 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:53:50,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:53:50,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:53:50,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:50,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:50,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:53:50,155 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-09 16:53:50,156 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@35bcf59e[Count = 0] remaining members to acquire global barrier 2023-02-09 16:53:50,156 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-09 16:53:50,156 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:50,157 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:50,157 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:50,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:50,157 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-09 16:53:50,157 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-09 16:53:50,157 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:50,157 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:53:50,157 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:53:50,160 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:50,160 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-09 16:53:50,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:50,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:53:50,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:53:50,161 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:53:50,161 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-09 16:53:50,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:53:50,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:53:50,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:50,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:50,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:53:50,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:50,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:50,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:53:50,165 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-09 16:53:50,165 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-09 16:53:50,165 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:53:50,165 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:53:50,165 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:50,165 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:53:50,167 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:50,167 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:50,167 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:53:50,167 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:50,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:50,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:53:50,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:53:50,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:50,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:53:50,168 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:53:50,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:53:50,168 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:50,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:50,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:50,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:53:50,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:50,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:50,169 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:50,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:53:50,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:50,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:50,173 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:50,173 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:53:50,173 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:50,173 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:53:50,173 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:50,173 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-09 16:53:50,174 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:53:50,173 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:53:50,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:53:50,173 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:53:50,174 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:50,174 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:50,174 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:50,174 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:50,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:53:50,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:53:50,174 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-09 16:53:50,174 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:53:50,275 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:53:50,275 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:53:50,275 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:53:50,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:53:50,283 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:53:50,283 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:53:50,284 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:53:50,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-09 16:53:50,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:50,287 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-09 16:53:50,287 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:53:50,288 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-09 16:53:50,288 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-09 16:53:50,288 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:50,288 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:50,290 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:50,290 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:53:50,290 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:53:50,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:53:50,290 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:50,291 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:53:50,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:50,291 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:50,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:53:50,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:50,291 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:50,292 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-09 16:53:50,292 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:50,292 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-09 16:53:50,292 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:53:50,292 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-09 16:53:50,292 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 16:53:50,293 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:53:50,293 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675961625127.e502a6fdf571512dee7d1db9a16a0c2f. 2023-02-09 16:53:50,293 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1675961625127.e502a6fdf571512dee7d1db9a16a0c2f. started... 2023-02-09 16:53:50,293 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e502a6fdf571512dee7d1db9a16a0c2f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 16:53:50,320 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205aa90284be41d40149ffff65c2265f5c0 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205aa90284be41d40149ffff65c2265f5c0 2023-02-09 16:53:50,734 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/.tmp/family1/32a475bd60b54ff6acdaf04cdbc84c8b 2023-02-09 16:53:50,743 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/.tmp/family1/32a475bd60b54ff6acdaf04cdbc84c8b as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/32a475bd60b54ff6acdaf04cdbc84c8b 2023-02-09 16:53:50,751 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/32a475bd60b54ff6acdaf04cdbc84c8b, entries=1, sequenceid=17, filesize=5.0 K 2023-02-09 16:53:50,753 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e502a6fdf571512dee7d1db9a16a0c2f in 460ms, sequenceid=17, compaction requested=true 2023-02-09 16:53:50,753 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e502a6fdf571512dee7d1db9a16a0c2f: 2023-02-09 16:53:50,753 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675961625127.e502a6fdf571512dee7d1db9a16a0c2f. 2023-02-09 16:53:50,753 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 16:53:50,754 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 16:53:50,754 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:50,754 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-09 16:53:50,754 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-09 16:53:50,757 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:50,757 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:50,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:50,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:53:50,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:53:50,757 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:50,757 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:53:50,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:53:50,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:53:50,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:50,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:50,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:53:50,759 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-09 16:53:50,759 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@430e4cd7[Count = 0] remaining members to acquire global barrier 2023-02-09 16:53:50,759 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-09 16:53:50,759 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:50,761 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:50,761 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:50,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:50,761 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-09 16:53:50,761 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-09 16:53:50,761 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:53:50,761 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:50,761 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:53:50,763 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-09 16:53:50,763 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:53:50,763 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:50,763 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-09 16:53:50,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:50,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:53:50,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:53:50,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:53:50,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:53:50,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:50,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:50,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:53:50,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:50,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:50,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:53:50,767 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-09 16:53:50,767 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-09 16:53:50,767 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:53:50,767 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:53:50,767 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:50,767 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:53:50,769 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:50,769 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:50,769 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:50,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:50,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:50,769 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:53:50,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:53:50,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:53:50,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:53:50,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:53:50,770 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:50,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:53:50,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:50,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:50,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:53:50,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:50,772 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:50,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:50,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:53:50,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:50,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:50,777 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:50,777 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:50,777 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:53:50,777 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:50,778 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:53:50,778 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-09 16:53:50,778 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:50,778 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-09 16:53:50,778 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:53:50,778 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:53:50,778 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:53:50,778 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:50,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:53:50,778 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:50,778 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:50,779 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-09 16:53:50,779 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:53:50,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:53:50,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:53:50,879 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:53:50,879 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:53:50,879 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:53:50,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:53:50,887 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:53:50,888 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:53:50,889 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:53:50,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-09 16:53:50,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:50,891 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-09 16:53:50,891 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:53:50,892 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-09 16:53:50,892 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-09 16:53:50,892 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:50,892 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:50,894 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:53:50,894 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:50,894 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:53:50,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:53:50,894 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:50,894 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:53:50,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:50,895 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:50,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:53:50,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:50,895 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:50,895 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-09 16:53:50,896 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:50,896 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-09 16:53:50,896 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:53:50,896 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-09 16:53:50,896 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 16:53:50,896 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:53:50,896 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675961625127.e502a6fdf571512dee7d1db9a16a0c2f. 2023-02-09 16:53:50,897 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1675961625127.e502a6fdf571512dee7d1db9a16a0c2f. started... 2023-02-09 16:53:50,897 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e502a6fdf571512dee7d1db9a16a0c2f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 16:53:51,325 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228e971739378964acfba634a17fc7aa66f to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228e971739378964acfba634a17fc7aa66f 2023-02-09 16:53:51,737 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/.tmp/family1/aa17421bbbc8414f965ee882243459a7 2023-02-09 16:53:51,746 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/.tmp/family1/aa17421bbbc8414f965ee882243459a7 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/aa17421bbbc8414f965ee882243459a7 2023-02-09 16:53:51,754 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/aa17421bbbc8414f965ee882243459a7, entries=1, sequenceid=21, filesize=5.0 K 2023-02-09 16:53:51,755 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e502a6fdf571512dee7d1db9a16a0c2f in 858ms, sequenceid=21, compaction requested=true 2023-02-09 16:53:51,755 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e502a6fdf571512dee7d1db9a16a0c2f: 2023-02-09 16:53:51,756 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675961625127.e502a6fdf571512dee7d1db9a16a0c2f. 2023-02-09 16:53:51,756 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 16:53:51,756 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 16:53:51,756 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:51,756 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-09 16:53:51,756 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-09 16:53:51,761 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:51,761 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:51,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:51,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:53:51,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:53:51,762 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:51,762 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:53:51,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:53:51,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:53:51,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:51,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:51,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:53:51,764 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-09 16:53:51,764 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@486a3308[Count = 0] remaining members to acquire global barrier 2023-02-09 16:53:51,764 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-09 16:53:51,764 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:51,767 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:51,768 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:51,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:51,768 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-09 16:53:51,768 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-09 16:53:51,768 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:53:51,768 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:51,768 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:53:51,769 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-09 16:53:51,769 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:51,769 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:53:51,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:51,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:53:51,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:53:51,769 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-09 16:53:51,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:53:51,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:53:51,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:51,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:51,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:53:51,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:51,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:51,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:53:51,805 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-09 16:53:51,806 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-09 16:53:51,806 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:53:51,806 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:53:51,806 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:51,806 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:53:51,807 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:51,807 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:51,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:51,808 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:51,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:53:51,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:53:51,808 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:53:51,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:51,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:53:51,808 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:51,808 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:53:51,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:53:51,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:51,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:51,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:53:51,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:51,810 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:51,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:51,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:53:51,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:51,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:51,812 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:51,812 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:51,812 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:53:51,812 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:51,812 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:53:51,812 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:53:51,812 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:53:51,812 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-09 16:53:51,813 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:53:51,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:53:51,812 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:51,813 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:51,813 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:51,813 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:51,813 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:53:51,813 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-09 16:53:51,814 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:53:51,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:53:51,914 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:53:51,914 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:53:51,914 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:53:51,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:53:51,922 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:53:51,922 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:53:51,923 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:53:51,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-09 16:53:51,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:51,925 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-09 16:53:51,925 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:53:51,925 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-09 16:53:51,925 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-09 16:53:51,926 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:51,926 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:51,929 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:53:51,929 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:51,929 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:53:51,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:53:51,929 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:51,929 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:53:51,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:51,929 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:51,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:53:51,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:51,930 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:51,930 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:51,930 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-09 16:53:51,930 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:53:51,931 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-09 16:53:51,931 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 16:53:51,931 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:53:51,931 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675961625127.e502a6fdf571512dee7d1db9a16a0c2f. 2023-02-09 16:53:51,931 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1675961625127.e502a6fdf571512dee7d1db9a16a0c2f. started... 2023-02-09 16:53:51,931 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e502a6fdf571512dee7d1db9a16a0c2f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 16:53:52,353 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512315d512cffc86549ff8b19258a2d101528 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512315d512cffc86549ff8b19258a2d101528 2023-02-09 16:53:52,362 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/.tmp/family1/6e843fa67fc64f6a99c82dc8776d8ddf 2023-02-09 16:53:52,370 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/.tmp/family1/6e843fa67fc64f6a99c82dc8776d8ddf as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/6e843fa67fc64f6a99c82dc8776d8ddf 2023-02-09 16:53:52,377 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/6e843fa67fc64f6a99c82dc8776d8ddf, entries=1, sequenceid=25, filesize=5.0 K 2023-02-09 16:53:52,379 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e502a6fdf571512dee7d1db9a16a0c2f in 448ms, sequenceid=25, compaction requested=true 2023-02-09 16:53:52,379 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e502a6fdf571512dee7d1db9a16a0c2f: 2023-02-09 16:53:52,379 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675961625127.e502a6fdf571512dee7d1db9a16a0c2f. 2023-02-09 16:53:52,380 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 16:53:52,380 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 16:53:52,380 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:52,380 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-09 16:53:52,380 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-09 16:53:52,382 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:52,382 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:52,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:52,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:53:52,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:53:52,383 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:52,383 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:53:52,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:53:52,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:53:52,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:52,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:52,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:53:52,385 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-09 16:53:52,385 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@157be05b[Count = 0] remaining members to acquire global barrier 2023-02-09 16:53:52,385 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-09 16:53:52,385 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:52,386 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:52,386 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:52,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:52,386 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-09 16:53:52,386 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-09 16:53:52,386 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:52,387 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:53:52,386 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:53:52,388 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:52,388 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-09 16:53:52,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:52,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:53:52,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:53:52,388 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:53:52,388 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-09 16:53:52,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:53:52,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:53:52,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:52,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:52,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:53:52,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:52,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:52,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:53:52,392 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-09 16:53:52,392 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-09 16:53:52,392 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:53:52,392 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:53:52,392 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:52,392 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:53:52,395 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:52,395 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:52,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:52,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:53:52,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:53:52,395 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:52,395 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:53:52,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:52,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:53:52,396 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:52,396 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:53:52,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:53:52,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:52,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:52,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:53:52,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:52,398 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:52,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:52,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:53:52,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:52,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:52,400 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:52,400 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:52,400 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:53:52,400 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:52,400 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-09 16:53:52,401 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:53:52,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:53:52,400 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:53:52,400 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:53:52,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:53:52,400 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:52,401 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:52,401 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:52,401 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:52,401 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-09 16:53:52,402 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:53:52,402 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:53:52,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:53:52,502 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:53:52,502 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:53:52,502 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:53:52,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:53:52,510 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:53:52,510 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:53:52,511 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:53:52,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-09 16:53:52,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:52,513 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-09 16:53:52,513 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:53:52,514 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-09 16:53:52,514 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-09 16:53:52,514 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:52,514 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:52,516 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:52,516 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:53:52,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:53:52,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:53:52,516 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:52,516 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:53:52,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:52,517 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:52,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:53:52,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:52,518 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:52,518 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-09 16:53:52,518 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:52,518 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-09 16:53:52,518 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:53:52,518 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-09 16:53:52,519 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 16:53:52,519 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:53:52,519 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675961625127.e502a6fdf571512dee7d1db9a16a0c2f. 2023-02-09 16:53:52,519 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1675961625127.e502a6fdf571512dee7d1db9a16a0c2f. started... 2023-02-09 16:53:52,519 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e502a6fdf571512dee7d1db9a16a0c2f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 16:53:52,942 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010175e34ce5fb8945508f98d78699a055bb to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010175e34ce5fb8945508f98d78699a055bb 2023-02-09 16:53:53,350 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/.tmp/family1/7e2f76a7653a43e9baff78222c4cb83d 2023-02-09 16:53:53,359 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/.tmp/family1/7e2f76a7653a43e9baff78222c4cb83d as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/7e2f76a7653a43e9baff78222c4cb83d 2023-02-09 16:53:53,367 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/7e2f76a7653a43e9baff78222c4cb83d, entries=1, sequenceid=29, filesize=5.0 K 2023-02-09 16:53:53,368 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e502a6fdf571512dee7d1db9a16a0c2f in 849ms, sequenceid=29, compaction requested=true 2023-02-09 16:53:53,369 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e502a6fdf571512dee7d1db9a16a0c2f: 2023-02-09 16:53:53,369 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675961625127.e502a6fdf571512dee7d1db9a16a0c2f. 2023-02-09 16:53:53,369 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 16:53:53,369 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 16:53:53,369 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:53,369 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-09 16:53:53,370 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-09 16:53:53,371 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:53,371 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:53,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:53,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:53:53,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:53:53,372 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:53,372 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:53:53,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:53:53,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:53:53,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:53,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:53,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:53:53,373 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-09 16:53:53,373 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@47b9e76f[Count = 0] remaining members to acquire global barrier 2023-02-09 16:53:53,373 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-09 16:53:53,374 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:53,375 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:53,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:53,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:53,375 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-09 16:53:53,375 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:53,375 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:53:53,375 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-09 16:53:53,375 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:53:53,376 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-09 16:53:53,376 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:53,376 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:53:53,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:53,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:53:53,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:53:53,377 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-09 16:53:53,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:53:53,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:53:53,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:53,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:53,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:53:53,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:53,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:53,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:53:53,379 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-09 16:53:53,379 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-09 16:53:53,379 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:53:53,379 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:53:53,379 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:53,380 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:53:53,382 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:53,382 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:53,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:53,382 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:53,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:53,382 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:53:53,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:53:53,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:53:53,383 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:53:53,383 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:53,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:53:53,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:53:53,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:53,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:53,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:53:53,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:53,384 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:53,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:53,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:53:53,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:53,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:53,389 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:53,389 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:53:53,389 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:53,389 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:53:53,390 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:53:53,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:53:53,390 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-09 16:53:53,390 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:53:53,390 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-09 16:53:53,389 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:53,389 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:53:53,390 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:53,390 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:53:53,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:53:53,390 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:53,391 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:53,391 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:53,391 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-09 16:53:53,391 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:53:53,491 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:53:53,491 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:53:53,491 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:53:53,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:53:53,500 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:53:53,500 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:53:53,501 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:53:53,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-09 16:53:53,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:53,503 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-09 16:53:53,503 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:53:53,504 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-09 16:53:53,504 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-09 16:53:53,504 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:53,504 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:53,506 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:53,506 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:53:53,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:53:53,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:53:53,506 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:53,506 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:53:53,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:53,507 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:53,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:53:53,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:53,507 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:53,507 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-09 16:53:53,507 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:53,507 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-09 16:53:53,507 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:53:53,508 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-09 16:53:53,508 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 16:53:53,508 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:53:53,508 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675961625127.e502a6fdf571512dee7d1db9a16a0c2f. 2023-02-09 16:53:53,508 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1675961625127.e502a6fdf571512dee7d1db9a16a0c2f. started... 2023-02-09 16:53:53,508 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e502a6fdf571512dee7d1db9a16a0c2f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 16:53:53,929 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103767be4d119a6432bbc95eb25049a1248 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103767be4d119a6432bbc95eb25049a1248 2023-02-09 16:53:53,938 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/.tmp/family1/ec7b70438cd84d10840df665d48981c8 2023-02-09 16:53:53,944 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/.tmp/family1/ec7b70438cd84d10840df665d48981c8 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/ec7b70438cd84d10840df665d48981c8 2023-02-09 16:53:53,951 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/ec7b70438cd84d10840df665d48981c8, entries=1, sequenceid=33, filesize=5.0 K 2023-02-09 16:53:53,952 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e502a6fdf571512dee7d1db9a16a0c2f in 444ms, sequenceid=33, compaction requested=true 2023-02-09 16:53:53,953 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e502a6fdf571512dee7d1db9a16a0c2f: 2023-02-09 16:53:53,953 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675961625127.e502a6fdf571512dee7d1db9a16a0c2f. 2023-02-09 16:53:53,953 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 16:53:53,953 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 16:53:53,953 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:53,953 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-09 16:53:53,953 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-09 16:53:53,955 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:53,955 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:53,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:53,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:53:53,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:53:53,956 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:53,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:53:53,956 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:53:53,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:53:53,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:53,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:53,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:53:53,957 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-09 16:53:53,958 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@76e073bb[Count = 0] remaining members to acquire global barrier 2023-02-09 16:53:53,958 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-09 16:53:53,958 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:53,959 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:53,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:53,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:53,960 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-09 16:53:53,960 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-09 16:53:53,960 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:53:53,960 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:53,960 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:53:53,961 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:53,961 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-09 16:53:53,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:53,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:53:53,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:53:53,961 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:53:53,961 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-09 16:53:53,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:53:53,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:53:53,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:53,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:53,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:53:53,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:53,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:53,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:53:53,964 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-09 16:53:53,964 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-09 16:53:53,965 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:53:53,965 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:53:53,965 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:53,965 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:53:53,966 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:53,966 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:53,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:53,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:53:53,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:53:53,966 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:53,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:53,966 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:53:53,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:53:53,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:53:53,967 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:53,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:53:53,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:53,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:53,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:53:53,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:53,968 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:53,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:53,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:53:53,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:53,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:53,970 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:53,970 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:53,970 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:53,971 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:53,971 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:53:53,971 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-09 16:53:53,971 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:53:53,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:53:53,971 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:53:53,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:53:53,971 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:53,971 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:53,971 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:53,971 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:53:53,971 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-09 16:53:53,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:53:53,971 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:53:53,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:53:54,072 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:53:54,072 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:53:54,072 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:53:54,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:53:54,080 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:53:54,080 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:53:54,081 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:53:54,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-09 16:53:54,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:54,084 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-09 16:53:54,084 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:53:54,084 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-09 16:53:54,084 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-09 16:53:54,085 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:54,085 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:54,087 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:54,087 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:53:54,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:53:54,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:53:54,087 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:54,087 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:53:54,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:54,088 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:54,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:53:54,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:54,088 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:54,089 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-09 16:53:54,089 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:54,090 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-09 16:53:54,090 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:53:54,090 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-09 16:53:54,090 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 16:53:54,090 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:53:54,090 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675961625127.e502a6fdf571512dee7d1db9a16a0c2f. 2023-02-09 16:53:54,091 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1675961625127.e502a6fdf571512dee7d1db9a16a0c2f. started... 2023-02-09 16:53:54,091 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e502a6fdf571512dee7d1db9a16a0c2f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 16:53:54,515 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015090759844cbe86164e56b585e18c2fc65821 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015090759844cbe86164e56b585e18c2fc65821 2023-02-09 16:53:54,925 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/.tmp/family1/0bb5ac4e1e314e6f971bbdd5a5c5f10f 2023-02-09 16:53:54,933 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/.tmp/family1/0bb5ac4e1e314e6f971bbdd5a5c5f10f as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/0bb5ac4e1e314e6f971bbdd5a5c5f10f 2023-02-09 16:53:54,940 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/0bb5ac4e1e314e6f971bbdd5a5c5f10f, entries=1, sequenceid=37, filesize=5.0 K 2023-02-09 16:53:54,942 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e502a6fdf571512dee7d1db9a16a0c2f in 851ms, sequenceid=37, compaction requested=true 2023-02-09 16:53:54,942 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e502a6fdf571512dee7d1db9a16a0c2f: 2023-02-09 16:53:54,942 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675961625127.e502a6fdf571512dee7d1db9a16a0c2f. 2023-02-09 16:53:54,942 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 16:53:54,942 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 16:53:54,942 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:54,943 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-09 16:53:54,943 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-09 16:53:54,944 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:54,944 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:54,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:54,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:53:54,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:53:54,945 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:54,945 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:53:54,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:53:54,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:53:54,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:54,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:54,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:53:54,946 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-09 16:53:54,946 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6f0bfc1c[Count = 0] remaining members to acquire global barrier 2023-02-09 16:53:54,946 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-09 16:53:54,946 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:54,947 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:54,947 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:54,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:54,947 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-09 16:53:54,947 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-09 16:53:54,947 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:53:54,948 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:54,948 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:53:54,949 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-09 16:53:54,949 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:53:54,949 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:54,949 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-09 16:53:54,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:54,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:53:54,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:53:54,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:53:54,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:53:54,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:54,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:54,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:53:54,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:54,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:54,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:53:54,952 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-09 16:53:54,952 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-09 16:53:54,952 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:53:54,952 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:53:54,952 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:54,952 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:53:54,955 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:54,955 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:54,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:54,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:53:54,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:53:54,955 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:54,955 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:53:54,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:54,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:53:54,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:53:54,956 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:54,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:53:54,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:54,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:54,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:53:54,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:54,957 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:54,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:54,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:53:54,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:54,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:54,959 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:54,959 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:54,959 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:53:54,959 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:54,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:53:54,960 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:54,960 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:53:54,960 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-09 16:53:54,960 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:53:54,960 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:53:54,960 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:54,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:53:54,960 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:54,960 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:54,961 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-09 16:53:54,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:53:54,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:53:54,961 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:53:55,061 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:53:55,061 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:53:55,062 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:53:55,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:53:55,070 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:53:55,070 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:53:55,071 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:53:55,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-09 16:53:55,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:55,074 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-09 16:53:55,074 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:53:55,075 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-09 16:53:55,075 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-09 16:53:55,075 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:55,075 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:55,077 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:55,077 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:53:55,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:53:55,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:53:55,077 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:55,077 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:53:55,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:55,078 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:55,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:53:55,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:55,078 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:55,078 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-09 16:53:55,078 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:55,079 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-09 16:53:55,079 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:53:55,080 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-09 16:53:55,080 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 16:53:55,080 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:53:55,080 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675961625127.e502a6fdf571512dee7d1db9a16a0c2f. 2023-02-09 16:53:55,080 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1675961625127.e502a6fdf571512dee7d1db9a16a0c2f. started... 2023-02-09 16:53:55,080 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e502a6fdf571512dee7d1db9a16a0c2f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 16:53:55,501 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511203e034519992440db91351afd14690064 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511203e034519992440db91351afd14690064 2023-02-09 16:53:55,936 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/.tmp/family1/f3447bcbec134db1886a33a8fa50c8d7 2023-02-09 16:53:55,944 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/.tmp/family1/f3447bcbec134db1886a33a8fa50c8d7 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/f3447bcbec134db1886a33a8fa50c8d7 2023-02-09 16:53:55,951 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/f3447bcbec134db1886a33a8fa50c8d7, entries=1, sequenceid=41, filesize=5.0 K 2023-02-09 16:53:55,952 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e502a6fdf571512dee7d1db9a16a0c2f in 872ms, sequenceid=41, compaction requested=true 2023-02-09 16:53:55,952 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e502a6fdf571512dee7d1db9a16a0c2f: 2023-02-09 16:53:55,952 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675961625127.e502a6fdf571512dee7d1db9a16a0c2f. 2023-02-09 16:53:55,952 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 16:53:55,953 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 16:53:55,953 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:55,953 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-09 16:53:55,953 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-09 16:53:55,954 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:55,954 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:55,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:55,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:53:55,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:53:55,955 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:55,955 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:53:55,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:53:55,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:53:55,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:55,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:55,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:53:55,956 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-09 16:53:55,956 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2538b09e[Count = 0] remaining members to acquire global barrier 2023-02-09 16:53:55,956 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-09 16:53:55,957 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:55,963 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:55,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:55,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:55,964 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-09 16:53:55,964 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:55,964 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:53:55,964 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-09 16:53:55,964 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:53:55,967 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-09 16:53:55,967 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:55,967 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:53:55,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:55,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:53:55,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:53:55,967 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-09 16:53:55,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:53:55,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:53:55,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:55,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:55,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:53:55,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:55,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:55,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:53:55,971 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-09 16:53:55,971 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-09 16:53:55,971 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:53:55,971 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:53:55,971 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:55,971 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:53:55,973 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:55,973 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:55,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:55,973 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:55,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:53:55,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:53:55,973 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:53:55,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:55,974 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:55,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:53:55,974 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:53:55,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:53:55,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:55,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:55,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:53:55,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:55,975 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:55,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:55,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:53:55,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:55,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:55,977 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:55,977 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:55,977 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:55,977 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:55,977 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:53:55,977 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-09 16:53:55,977 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:53:55,977 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:55,977 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:53:55,977 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:55,978 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:53:55,978 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:55,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:53:55,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:53:55,978 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-09 16:53:55,978 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-09 16:53:55,978 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:53:55,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:53:55,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:53:56,078 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:53:56,078 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:53:56,078 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:53:56,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:53:56,085 DEBUG [Listener at localhost/41619] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-09 16:53:56,087 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48120, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-09 16:53:56,089 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=41333] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:56,101 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-09 16:53:56,102 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-09 16:53:56,104 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=12, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675962236104 2023-02-09 16:53:56,104 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 16:53:56,107 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-09 16:53:56,112 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-02-09 16:53:56,112 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-09 16:53:56,112 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] zookeeper.ReadOnlyZKClient(139): Connect 0x2ff994a1 to 127.0.0.1:53887 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 16:53:56,117 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6534868b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 16:53:56,119 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-09 16:53:56,995 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010394c9e0fab1d9409190b445faa12d4323 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010394c9e0fab1d9409190b445faa12d4323 2023-02-09 16:53:56,996 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-09 16:53:57,015 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 16:53:57,016 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50014, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 16:53:57,026 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:53:57,027 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:53:57,027 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-09 16:53:57,029 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48122, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-09 16:53:57,064 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/72c824e8d32d4d3689c8325c6e5eed84 first=Optional[r3] last=Optional[r6] 2023-02-09 16:53:57,076 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1675961625127.e502a6fdf571512dee7d1db9a16a0c2f., hostname=jenkins-hbase4.apache.org,35511,1675961620699, seqNum=2 for row with hfile group [{family1,hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/72c824e8d32d4d3689c8325c6e5eed84}] 2023-02-09 16:53:57,093 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(763): Validating hfile at hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/72c824e8d32d4d3689c8325c6e5eed84 for inclusion in e502a6fdf571512dee7d1db9a16a0c2f/family1 2023-02-09 16:53:57,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-02-09 16:53:57,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(777): Region bounds: first= last= 2023-02-09 16:53:57,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HRegion(2445): Flush status journal for e502a6fdf571512dee7d1db9a16a0c2f: 2023-02-09 16:53:57,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/72c824e8d32d4d3689c8325c6e5eed84 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__t5okqe7r58960hdu0kc701ub804ttd60h82nqpv6ikfb8geqf313ibjvs0b1quhe/family1/72c824e8d32d4d3689c8325c6e5eed84 2023-02-09 16:53:57,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__t5okqe7r58960hdu0kc701ub804ttd60h82nqpv6ikfb8geqf313ibjvs0b1quhe/family1/72c824e8d32d4d3689c8325c6e5eed84 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/e122357c0f014e0abdcf6f6e27768724_SeqId_44_ 2023-02-09 16:53:57,106 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(849): Loaded HFile hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__t5okqe7r58960hdu0kc701ub804ttd60h82nqpv6ikfb8geqf313ibjvs0b1quhe/family1/72c824e8d32d4d3689c8325c6e5eed84 into e502a6fdf571512dee7d1db9a16a0c2f/family1 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/e122357c0f014e0abdcf6f6e27768724_SeqId_44_ - updating store file list. 2023-02-09 16:53:57,112 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(882): Loaded HFile hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/e122357c0f014e0abdcf6f6e27768724_SeqId_44_ into e502a6fdf571512dee7d1db9a16a0c2f/family1 2023-02-09 16:53:57,112 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(855): Successfully loaded hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__t5okqe7r58960hdu0kc701ub804ttd60h82nqpv6ikfb8geqf313ibjvs0b1quhe/family1/72c824e8d32d4d3689c8325c6e5eed84 into e502a6fdf571512dee7d1db9a16a0c2f/family1 (new location: hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/e122357c0f014e0abdcf6f6e27768724_SeqId_44_) 2023-02-09 16:53:57,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__t5okqe7r58960hdu0kc701ub804ttd60h82nqpv6ikfb8geqf313ibjvs0b1quhe/family1/72c824e8d32d4d3689c8325c6e5eed84 2023-02-09 16:53:57,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-09 16:53:57,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51357 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-09 16:53:57,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(1912): e502a6fdf571512dee7d1db9a16a0c2f/family1 is initiating minor compaction 2023-02-09 16:53:57,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@50143f8e; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 16:53:57,123 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of e502a6fdf571512dee7d1db9a16a0c2f/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1675961625127.e502a6fdf571512dee7d1db9a16a0c2f. 2023-02-09 16:53:57,124 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/db8dd8b51a22488bb430cc4c9b0df89f, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/6051a2ebe2a24f799971c7d73c0c892b, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/32a475bd60b54ff6acdaf04cdbc84c8b, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/aa17421bbbc8414f965ee882243459a7, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/6e843fa67fc64f6a99c82dc8776d8ddf, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/7e2f76a7653a43e9baff78222c4cb83d, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/ec7b70438cd84d10840df665d48981c8, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/0bb5ac4e1e314e6f971bbdd5a5c5f10f, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/f3447bcbec134db1886a33a8fa50c8d7, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/e122357c0f014e0abdcf6f6e27768724_SeqId_44_] into tmpdir=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/.tmp, totalSize=50.2 K 2023-02-09 16:53:57,125 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting db8dd8b51a22488bb430cc4c9b0df89f, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-09 16:53:57,125 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting 6051a2ebe2a24f799971c7d73c0c892b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-09 16:53:57,125 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting 32a475bd60b54ff6acdaf04cdbc84c8b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-09 16:53:57,125 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting aa17421bbbc8414f965ee882243459a7, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-09 16:53:57,125 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting 6e843fa67fc64f6a99c82dc8776d8ddf, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-09 16:53:57,125 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting 7e2f76a7653a43e9baff78222c4cb83d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-09 16:53:57,125 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting ec7b70438cd84d10840df665d48981c8, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-09 16:53:57,125 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting 0bb5ac4e1e314e6f971bbdd5a5c5f10f, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-09 16:53:57,125 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting f3447bcbec134db1886a33a8fa50c8d7, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-09 16:53:57,125 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting e122357c0f014e0abdcf6f6e27768724_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-09 16:53:57,139 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-09 16:53:57,140 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 16:53:57,146 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228e971739378964acfba634a17fc7aa66f to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228e971739378964acfba634a17fc7aa66f 2023-02-09 16:53:57,148 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512315d512cffc86549ff8b19258a2d101528 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512315d512cffc86549ff8b19258a2d101528 2023-02-09 16:53:57,150 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010175e34ce5fb8945508f98d78699a055bb to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010175e34ce5fb8945508f98d78699a055bb 2023-02-09 16:53:57,152 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103767be4d119a6432bbc95eb25049a1248 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103767be4d119a6432bbc95eb25049a1248 2023-02-09 16:53:57,152 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 4 expired mob files are deleted 2023-02-09 16:53:57,152 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-02-09 16:53:57,153 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-09 16:53:57,153 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-09 16:53:57,153 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-09 16:53:57,153 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-09 16:53:57,153 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-09 16:53:57,153 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-09 16:53:57,153 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-09 16:53:57,153 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-09 16:53:57,176 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] throttle.PressureAwareThroughputController(145): e502a6fdf571512dee7d1db9a16a0c2f#family1#compaction#10 average throughput is 0.36 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 16:53:58,008 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/.tmp/family1/1140e8ad6cf34eb38b5aca97e9012c2b as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/1140e8ad6cf34eb38b5aca97e9012c2b 2023-02-09 16:53:58,027 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in e502a6fdf571512dee7d1db9a16a0c2f/family1 of e502a6fdf571512dee7d1db9a16a0c2f into 1140e8ad6cf34eb38b5aca97e9012c2b(size=6.6 K), total size for store is 182.5 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-09 16:53:58,027 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for e502a6fdf571512dee7d1db9a16a0c2f: 2023-02-09 16:53:58,029 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1675961625127.e502a6fdf571512dee7d1db9a16a0c2f., storeName=family1, fileCount=10, fileSize=50.2 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.5 K), priority=2, time=1675961637121; duration=0sec 2023-02-09 16:53:58,030 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 16:53:58,051 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120594e0d96ca47247e1a079e27d471f3366 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015120594e0d96ca47247e1a079e27d471f3366 2023-02-09 16:53:58,055 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-09 16:53:58,058 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/db8dd8b51a22488bb430cc4c9b0df89f, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/6051a2ebe2a24f799971c7d73c0c892b, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/32a475bd60b54ff6acdaf04cdbc84c8b, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/aa17421bbbc8414f965ee882243459a7, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/6e843fa67fc64f6a99c82dc8776d8ddf, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/7e2f76a7653a43e9baff78222c4cb83d, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/ec7b70438cd84d10840df665d48981c8, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/0bb5ac4e1e314e6f971bbdd5a5c5f10f, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/f3447bcbec134db1886a33a8fa50c8d7, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/e122357c0f014e0abdcf6f6e27768724_SeqId_44_] to archive 2023-02-09 16:53:58,059 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 16:53:58,061 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/db8dd8b51a22488bb430cc4c9b0df89f to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/db8dd8b51a22488bb430cc4c9b0df89f 2023-02-09 16:53:58,063 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/6051a2ebe2a24f799971c7d73c0c892b to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/6051a2ebe2a24f799971c7d73c0c892b 2023-02-09 16:53:58,064 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/32a475bd60b54ff6acdaf04cdbc84c8b to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/32a475bd60b54ff6acdaf04cdbc84c8b 2023-02-09 16:53:58,066 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/aa17421bbbc8414f965ee882243459a7 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/aa17421bbbc8414f965ee882243459a7 2023-02-09 16:53:58,067 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/6e843fa67fc64f6a99c82dc8776d8ddf to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/6e843fa67fc64f6a99c82dc8776d8ddf 2023-02-09 16:53:58,069 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/7e2f76a7653a43e9baff78222c4cb83d to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/7e2f76a7653a43e9baff78222c4cb83d 2023-02-09 16:53:58,071 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/ec7b70438cd84d10840df665d48981c8 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/ec7b70438cd84d10840df665d48981c8 2023-02-09 16:53:58,073 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/0bb5ac4e1e314e6f971bbdd5a5c5f10f to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/0bb5ac4e1e314e6f971bbdd5a5c5f10f 2023-02-09 16:53:58,075 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/f3447bcbec134db1886a33a8fa50c8d7 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/f3447bcbec134db1886a33a8fa50c8d7 2023-02-09 16:53:58,077 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/e122357c0f014e0abdcf6f6e27768724_SeqId_44_ to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/e122357c0f014e0abdcf6f6e27768724_SeqId_44_ 2023-02-09 16:53:58,079 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:53:58,080 INFO [MobCompactor-pool-0] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:53:58,091 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/cd91bd29728847b4869501eb836e72f6 first=Optional[r00] last=Optional[r2] 2023-02-09 16:53:58,094 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1675961625127.e502a6fdf571512dee7d1db9a16a0c2f., hostname=jenkins-hbase4.apache.org,35511,1675961620699, seqNum=2 for row with hfile group [{family1,hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/cd91bd29728847b4869501eb836e72f6}] 2023-02-09 16:53:58,096 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(763): Validating hfile at hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/cd91bd29728847b4869501eb836e72f6 for inclusion in e502a6fdf571512dee7d1db9a16a0c2f/family1 2023-02-09 16:53:58,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-02-09 16:53:58,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(777): Region bounds: first= last= 2023-02-09 16:53:58,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HRegion(2445): Flush status journal for e502a6fdf571512dee7d1db9a16a0c2f: 2023-02-09 16:53:58,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/cd91bd29728847b4869501eb836e72f6 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__tvvj2mhj2pu91tjk1suu74hbppng0novrakrj28bmk45r8kalqaev7mgcchme2sg/family1/cd91bd29728847b4869501eb836e72f6 2023-02-09 16:53:58,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__tvvj2mhj2pu91tjk1suu74hbppng0novrakrj28bmk45r8kalqaev7mgcchme2sg/family1/cd91bd29728847b4869501eb836e72f6 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/6a33b7f17db54e9bb1bae9dfc893a177_SeqId_47_ 2023-02-09 16:53:58,106 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(849): Loaded HFile hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__tvvj2mhj2pu91tjk1suu74hbppng0novrakrj28bmk45r8kalqaev7mgcchme2sg/family1/cd91bd29728847b4869501eb836e72f6 into e502a6fdf571512dee7d1db9a16a0c2f/family1 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/6a33b7f17db54e9bb1bae9dfc893a177_SeqId_47_ - updating store file list. 2023-02-09 16:53:58,114 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(882): Loaded HFile hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/6a33b7f17db54e9bb1bae9dfc893a177_SeqId_47_ into e502a6fdf571512dee7d1db9a16a0c2f/family1 2023-02-09 16:53:58,114 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(855): Successfully loaded hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__tvvj2mhj2pu91tjk1suu74hbppng0novrakrj28bmk45r8kalqaev7mgcchme2sg/family1/cd91bd29728847b4869501eb836e72f6 into e502a6fdf571512dee7d1db9a16a0c2f/family1 (new location: hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/6a33b7f17db54e9bb1bae9dfc893a177_SeqId_47_) 2023-02-09 16:53:58,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__tvvj2mhj2pu91tjk1suu74hbppng0novrakrj28bmk45r8kalqaev7mgcchme2sg/family1/cd91bd29728847b4869501eb836e72f6 2023-02-09 16:53:58,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-09 16:53:58,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 367249 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-09 16:53:58,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(1912): e502a6fdf571512dee7d1db9a16a0c2f/family1 is initiating minor compaction (all files) 2023-02-09 16:53:58,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@411e225d; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 16:53:58,117 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of e502a6fdf571512dee7d1db9a16a0c2f/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1675961625127.e502a6fdf571512dee7d1db9a16a0c2f. 2023-02-09 16:53:58,117 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/c1d882d6610143c1929e108bbe0b5261, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/1140e8ad6cf34eb38b5aca97e9012c2b, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/6a33b7f17db54e9bb1bae9dfc893a177_SeqId_47_] into tmpdir=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/.tmp, totalSize=358.6 K 2023-02-09 16:53:58,118 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting c1d882d6610143c1929e108bbe0b5261, keycount=1000, bloomtype=ROW, size=175.8 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878845085 2023-02-09 16:53:58,118 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting 1140e8ad6cf34eb38b5aca97e9012c2b, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621245085 2023-02-09 16:53:58,119 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-09 16:53:58,120 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting 6a33b7f17db54e9bb1bae9dfc893a177_SeqId_47_, keycount=1002, bloomtype=ROW, size=176.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878845085 2023-02-09 16:53:58,120 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 16:53:58,123 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130b996a79ab4774a1782f34375de9895a3 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130b996a79ab4774a1782f34375de9895a3 2023-02-09 16:53:58,125 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201600cd91bc03c4883ac92ecfef877acbc to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201600cd91bc03c4883ac92ecfef877acbc 2023-02-09 16:53:58,127 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205aa90284be41d40149ffff65c2265f5c0 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205aa90284be41d40149ffff65c2265f5c0 2023-02-09 16:53:58,127 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 3 expired mob files are deleted 2023-02-09 16:53:58,127 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-02-09 16:53:58,128 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-09 16:53:58,128 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-09 16:53:58,128 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 16:53:58,129 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=12, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-09 16:53:58,132 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 2.0360 sec 2023-02-09 16:53:58,162 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] throttle.PressureAwareThroughputController(145): e502a6fdf571512dee7d1db9a16a0c2f#family1#compaction#11 average throughput is 6.35 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 16:53:58,266 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:53:58,266 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:53:58,273 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.HMaster$12(2441): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthly from 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-02-09 16:53:58,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:58,700 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-02-09 16:53:58,702 DEBUG [PEWorker-3] util.FSTableDescriptors(519): Deleted hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-02-09 16:53:58,702 INFO [PEWorker-3] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-02-09 16:53:58,706 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly}] 2023-02-09 16:53:58,719 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=e502a6fdf571512dee7d1db9a16a0c2f, REOPEN/MOVE}] 2023-02-09 16:53:58,720 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=e502a6fdf571512dee7d1db9a16a0c2f, REOPEN/MOVE 2023-02-09 16:53:58,721 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=e502a6fdf571512dee7d1db9a16a0c2f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:58,721 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1675961625127.e502a6fdf571512dee7d1db9a16a0c2f.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1675961638721"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675961638721"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675961638721"}]},"ts":"1675961638721"} 2023-02-09 16:53:58,724 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE; CloseRegionProcedure e502a6fdf571512dee7d1db9a16a0c2f, server=jenkins-hbase4.apache.org,35511,1675961620699}] 2023-02-09 16:53:58,883 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close e502a6fdf571512dee7d1db9a16a0c2f 2023-02-09 16:53:58,883 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing e502a6fdf571512dee7d1db9a16a0c2f, disabling compactions & flushes 2023-02-09 16:53:58,883 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1857): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthly,,1675961625127.e502a6fdf571512dee7d1db9a16a0c2f. 2023-02-09 16:53:59,393 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/.tmp/family1/2b876789262a4c29b6b8d60793de787b as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/2b876789262a4c29b6b8d60793de787b 2023-02-09 16:53:59,400 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in e502a6fdf571512dee7d1db9a16a0c2f/family1 of e502a6fdf571512dee7d1db9a16a0c2f into 2b876789262a4c29b6b8d60793de787b(size=177.2 K), total size for store is 177.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-09 16:53:59,400 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for e502a6fdf571512dee7d1db9a16a0c2f: 2023-02-09 16:53:59,400 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1675961625127.e502a6fdf571512dee7d1db9a16a0c2f. 2023-02-09 16:53:59,401 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1675961625127.e502a6fdf571512dee7d1db9a16a0c2f. 2023-02-09 16:53:59,401 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1675961625127.e502a6fdf571512dee7d1db9a16a0c2f. after waiting 0 ms 2023-02-09 16:53:59,401 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1675961625127.e502a6fdf571512dee7d1db9a16a0c2f., storeName=family1, fileCount=3, fileSize=358.6 K (175.8 K, 6.6 K, 176.2 K), priority=2, time=1675961638117; duration=1sec 2023-02-09 16:53:59,401 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1675961625127.e502a6fdf571512dee7d1db9a16a0c2f. 2023-02-09 16:53:59,401 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 16:53:59,403 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1675961625127.e502a6fdf571512dee7d1db9a16a0c2f.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/c1d882d6610143c1929e108bbe0b5261, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/1140e8ad6cf34eb38b5aca97e9012c2b, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/6a33b7f17db54e9bb1bae9dfc893a177_SeqId_47_] to archive 2023-02-09 16:53:59,404 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1675961625127.e502a6fdf571512dee7d1db9a16a0c2f.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 16:53:59,406 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1675961625127.e502a6fdf571512dee7d1db9a16a0c2f.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/c1d882d6610143c1929e108bbe0b5261 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/c1d882d6610143c1929e108bbe0b5261 2023-02-09 16:53:59,408 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1675961625127.e502a6fdf571512dee7d1db9a16a0c2f.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/1140e8ad6cf34eb38b5aca97e9012c2b to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/1140e8ad6cf34eb38b5aca97e9012c2b 2023-02-09 16:53:59,409 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1675961625127.e502a6fdf571512dee7d1db9a16a0c2f.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/6a33b7f17db54e9bb1bae9dfc893a177_SeqId_47_ to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/6a33b7f17db54e9bb1bae9dfc893a177_SeqId_47_ 2023-02-09 16:53:59,415 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-02-09 16:53:59,416 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1675961625127.e502a6fdf571512dee7d1db9a16a0c2f. 2023-02-09 16:53:59,417 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for e502a6fdf571512dee7d1db9a16a0c2f: Waiting for close lock at 1675961638883Running coprocessor pre-close hooks at 1675961638883Disabling compacts and flushes for region at 1675961638883Disabling writes for close at 1675961639401 (+518 ms)Writing region close event to WAL at 1675961639412 (+11 ms)Running coprocessor post-close hooks at 1675961639416 (+4 ms)Closed at 1675961639416 2023-02-09 16:53:59,417 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3509): Not adding moved region record: e502a6fdf571512dee7d1db9a16a0c2f to self. 2023-02-09 16:53:59,419 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed e502a6fdf571512dee7d1db9a16a0c2f 2023-02-09 16:53:59,420 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=e502a6fdf571512dee7d1db9a16a0c2f, regionState=CLOSED 2023-02-09 16:53:59,420 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1675961625127.e502a6fdf571512dee7d1db9a16a0c2f.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1675961639419"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675961639419"}]},"ts":"1675961639419"} 2023-02-09 16:53:59,424 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-09 16:53:59,424 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; CloseRegionProcedure e502a6fdf571512dee7d1db9a16a0c2f, server=jenkins-hbase4.apache.org,35511,1675961620699 in 698 msec 2023-02-09 16:53:59,425 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=e502a6fdf571512dee7d1db9a16a0c2f, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,35511,1675961620699; forceNewPlan=false, retain=true 2023-02-09 16:53:59,575 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=e502a6fdf571512dee7d1db9a16a0c2f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:59,575 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1675961625127.e502a6fdf571512dee7d1db9a16a0c2f.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1675961639575"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675961639575"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675961639575"}]},"ts":"1675961639575"} 2023-02-09 16:53:59,578 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=15, state=RUNNABLE; OpenRegionProcedure e502a6fdf571512dee7d1db9a16a0c2f, server=jenkins-hbase4.apache.org,35511,1675961620699}] 2023-02-09 16:53:59,734 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1675961625127.e502a6fdf571512dee7d1db9a16a0c2f. 2023-02-09 16:53:59,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e502a6fdf571512dee7d1db9a16a0c2f, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1675961625127.e502a6fdf571512dee7d1db9a16a0c2f.', STARTKEY => '', ENDKEY => ''} 2023-02-09 16:53:59,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly e502a6fdf571512dee7d1db9a16a0c2f 2023-02-09 16:53:59,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1675961625127.e502a6fdf571512dee7d1db9a16a0c2f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 16:53:59,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for e502a6fdf571512dee7d1db9a16a0c2f 2023-02-09 16:53:59,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for e502a6fdf571512dee7d1db9a16a0c2f 2023-02-09 16:53:59,737 INFO [StoreOpener-e502a6fdf571512dee7d1db9a16a0c2f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region e502a6fdf571512dee7d1db9a16a0c2f 2023-02-09 16:53:59,738 DEBUG [StoreOpener-e502a6fdf571512dee7d1db9a16a0c2f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1 2023-02-09 16:53:59,738 DEBUG [StoreOpener-e502a6fdf571512dee7d1db9a16a0c2f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1 2023-02-09 16:53:59,738 INFO [StoreOpener-e502a6fdf571512dee7d1db9a16a0c2f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e502a6fdf571512dee7d1db9a16a0c2f columnFamilyName family1 2023-02-09 16:53:59,746 DEBUG [StoreOpener-e502a6fdf571512dee7d1db9a16a0c2f-1] regionserver.HStore(539): loaded hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/2b876789262a4c29b6b8d60793de787b 2023-02-09 16:53:59,746 INFO [StoreOpener-e502a6fdf571512dee7d1db9a16a0c2f-1] regionserver.HStore(310): Store=e502a6fdf571512dee7d1db9a16a0c2f/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 16:53:59,747 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f 2023-02-09 16:53:59,749 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f 2023-02-09 16:53:59,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for e502a6fdf571512dee7d1db9a16a0c2f 2023-02-09 16:53:59,753 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened e502a6fdf571512dee7d1db9a16a0c2f; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75209632, jitterRate=0.12071084976196289}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 16:53:59,753 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for e502a6fdf571512dee7d1db9a16a0c2f: Running coprocessor pre-open hook at 1675961639735Writing region info on filesystem at 1675961639735Initializing all the Stores at 1675961639736 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} at 1675961639736Cleaning up temporary data from old regions at 1675961639749 (+13 ms)Cleaning up detritus from prior splits at 1675961639750 (+1 ms)Running coprocessor post-open hooks at 1675961639753 (+3 ms)Region opened successfully at 1675961639753 2023-02-09 16:53:59,754 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1675961625127.e502a6fdf571512dee7d1db9a16a0c2f., pid=17, masterSystemTime=1675961639731 2023-02-09 16:53:59,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1675961625127.e502a6fdf571512dee7d1db9a16a0c2f. 2023-02-09 16:53:59,756 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1675961625127.e502a6fdf571512dee7d1db9a16a0c2f. 2023-02-09 16:53:59,756 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=e502a6fdf571512dee7d1db9a16a0c2f, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:53:59,757 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1675961625127.e502a6fdf571512dee7d1db9a16a0c2f.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1675961639756"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675961639756"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675961639756"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675961639756"}]},"ts":"1675961639756"} 2023-02-09 16:53:59,761 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=15 2023-02-09 16:53:59,761 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=15, state=SUCCESS; OpenRegionProcedure e502a6fdf571512dee7d1db9a16a0c2f, server=jenkins-hbase4.apache.org,35511,1675961620699 in 180 msec 2023-02-09 16:53:59,763 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-02-09 16:53:59,763 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=e502a6fdf571512dee7d1db9a16a0c2f, REOPEN/MOVE in 1.0420 sec 2023-02-09 16:53:59,766 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=13 2023-02-09 16:53:59,766 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=13, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 1.0590 sec 2023-02-09 16:53:59,768 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 1.4910 sec 2023-02-09 16:53:59,770 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:53:59,771 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:53:59,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=13 2023-02-09 16:53:59,773 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:53:59,773 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:53:59,778 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:53:59,778 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:53:59,779 INFO [Listener at localhost/41619] compactions.TestMobCompactor(278): alter status finished 2023-02-09 16:53:59,780 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41333] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 16:53:59,782 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-09 16:53:59,782 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-09 16:53:59,784 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 16:53:59,784 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675962239784 2023-02-09 16:53:59,785 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-09 16:53:59,785 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-02-09 16:53:59,785 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-09 16:53:59,786 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] zookeeper.ReadOnlyZKClient(139): Connect 0x75610f9b to 127.0.0.1:53887 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 16:53:59,792 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@32696b92, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 16:53:59,792 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-09 16:53:59,792 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-09 16:53:59,792 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-09 16:53:59,792 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-09 16:53:59,792 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-09 16:54:00,627 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128e013ca2bf2a24e1e8b2f84b1feaf5b07 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128e013ca2bf2a24e1e8b2f84b1feaf5b07 2023-02-09 16:54:00,629 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-09 16:54:00,643 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 16:54:00,645 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50030, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 16:54:00,652 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:00,652 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:00,652 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-09 16:54:00,654 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48126, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-09 16:54:00,666 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/54d9c149860c470a8044f2146842ae8d first=Optional[r05] last=Optional[r8] 2023-02-09 16:54:00,667 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1675961625127.e502a6fdf571512dee7d1db9a16a0c2f., hostname=jenkins-hbase4.apache.org,35511,1675961620699, seqNum=51 for row with hfile group [{family1,hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/54d9c149860c470a8044f2146842ae8d}] 2023-02-09 16:54:00,679 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(763): Validating hfile at hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/54d9c149860c470a8044f2146842ae8d for inclusion in e502a6fdf571512dee7d1db9a16a0c2f/family1 2023-02-09 16:54:00,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-02-09 16:54:00,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(777): Region bounds: first= last= 2023-02-09 16:54:00,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HRegion(2445): Flush status journal for e502a6fdf571512dee7d1db9a16a0c2f: 2023-02-09 16:54:00,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/54d9c149860c470a8044f2146842ae8d to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__7pualsv5i1q7fbof0kqpv7k52kg1j64jjq9kl19ucmlspqbpbgoun37kh4kaegkb/family1/54d9c149860c470a8044f2146842ae8d 2023-02-09 16:54:00,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__7pualsv5i1q7fbof0kqpv7k52kg1j64jjq9kl19ucmlspqbpbgoun37kh4kaegkb/family1/54d9c149860c470a8044f2146842ae8d as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/cb736f79f3134dd9b46460ddbdff64b2_SeqId_53_ 2023-02-09 16:54:00,688 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(849): Loaded HFile hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__7pualsv5i1q7fbof0kqpv7k52kg1j64jjq9kl19ucmlspqbpbgoun37kh4kaegkb/family1/54d9c149860c470a8044f2146842ae8d into e502a6fdf571512dee7d1db9a16a0c2f/family1 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/cb736f79f3134dd9b46460ddbdff64b2_SeqId_53_ - updating store file list. 2023-02-09 16:54:00,694 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(882): Loaded HFile hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/cb736f79f3134dd9b46460ddbdff64b2_SeqId_53_ into e502a6fdf571512dee7d1db9a16a0c2f/family1 2023-02-09 16:54:00,694 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(855): Successfully loaded hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__7pualsv5i1q7fbof0kqpv7k52kg1j64jjq9kl19ucmlspqbpbgoun37kh4kaegkb/family1/54d9c149860c470a8044f2146842ae8d into e502a6fdf571512dee7d1db9a16a0c2f/family1 (new location: hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/family1/cb736f79f3134dd9b46460ddbdff64b2_SeqId_53_) 2023-02-09 16:54:00,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__7pualsv5i1q7fbof0kqpv7k52kg1j64jjq9kl19ucmlspqbpbgoun37kh4kaegkb/family1/54d9c149860c470a8044f2146842ae8d 2023-02-09 16:54:00,697 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-09 16:54:00,698 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 16:54:00,700 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511203e034519992440db91351afd14690064 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511203e034519992440db91351afd14690064 2023-02-09 16:54:00,701 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112804de881d33f246fcbf4fc0adc9ea76df to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112804de881d33f246fcbf4fc0adc9ea76df 2023-02-09 16:54:00,701 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 2 expired mob files are deleted 2023-02-09 16:54:00,701 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-02-09 16:54:00,702 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-09 16:54:00,702 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-09 16:54:00,702 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-09 16:54:00,702 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-09 16:54:00,702 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 16:54:00,703 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-09 16:54:00,705 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 922 msec 2023-02-09 16:54:00,785 INFO [Listener at localhost/41619] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=247 (was 211) Potentially hanging thread: (jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobCompactor-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:53887@0x75610f9b-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:53887@0x75610f9b-SendThread(127.0.0.1:53887) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-806311842_15 at /127.0.0.1:52182 [Waiting for operation #20] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-806311842_15 at /127.0.0.1:52308 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x44a59331-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-806311842_15 at /127.0.0.1:52286 [Waiting for operation #14] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-806311842_15 at /127.0.0.1:52176 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xc16012-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS:0;jenkins-hbase4:35511-shortCompactions-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:549) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-806311842_15 at /127.0.0.1:52174 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-806311842_15 at /127.0.0.1:52148 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:53887@0x2ff994a1-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: hconnection-0xc16012-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5698638b-a3fc-8e58-7588-e5d09b0cf064/cluster_d6b3018f-2464-05f6-c84c-1699b67fed18/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RSProcedureDispatcher-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-806311842_15 at /127.0.0.1:52116 [Waiting for operation #14] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-806311842_15 at /127.0.0.1:52170 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-806311842_15 at /127.0.0.1:52258 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:53887@0x2ff994a1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/1671812890.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-806311842_15 at /127.0.0.1:52354 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-806311842_15 at /127.0.0.1:52216 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x44a59331-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:53887@0x75610f9b sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/1671812890.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1218191331_15 at /127.0.0.1:52274 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5698638b-a3fc-8e58-7588-e5d09b0cf064/cluster_d6b3018f-2464-05f6-c84c-1699b67fed18/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-806311842_15 at /127.0.0.1:52166 [Waiting for operation #17] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-806311842_15 at /127.0.0.1:52322 [Waiting for operation #21] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xc16012-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:53887@0x2ff994a1-SendThread(127.0.0.1:53887) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) - Thread LEAK? -, OpenFileDescriptor=589 (was 475) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=243 (was 340), ProcessCount=168 (was 168), AvailableMemoryMB=3931 (was 4039) 2023-02-09 16:54:00,800 INFO [Listener at localhost/41619] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=247, OpenFileDescriptor=589, MaxFileDescriptor=60000, SystemLoadAverage=243, ProcessCount=168, AvailableMemoryMB=3929 2023-02-09 16:54:00,801 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:00,801 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:00,805 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-02-09 16:54:00,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:00,811 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 16:54:00,812 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithMonthlyPolicy" procId is: 19 2023-02-09 16:54:00,812 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:00,812 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:00,812 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 16:54:00,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-09 16:54:00,814 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433 2023-02-09 16:54:00,815 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433 empty. 2023-02-09 16:54:00,815 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433 2023-02-09 16:54:00,815 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithMonthlyPolicy regions 2023-02-09 16:54:00,913 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:00,914 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:00,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-09 16:54:01,115 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:01,115 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:01,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-09 16:54:01,228 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-02-09 16:54:01,230 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7671): creating {ENCODED => 191a93f3202aa607fa4f5a0c922be433, NAME => 'testMajorCompactionWithMonthlyPolicy,,1675961640805.191a93f3202aa607fa4f5a0c922be433.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp 2023-02-09 16:54:01,249 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithMonthlyPolicy,,1675961640805.191a93f3202aa607fa4f5a0c922be433.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 16:54:01,249 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1603): Closing 191a93f3202aa607fa4f5a0c922be433, disabling compactions & flushes 2023-02-09 16:54:01,249 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithMonthlyPolicy,,1675961640805.191a93f3202aa607fa4f5a0c922be433. 2023-02-09 16:54:01,249 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1675961640805.191a93f3202aa607fa4f5a0c922be433. 2023-02-09 16:54:01,249 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1675961640805.191a93f3202aa607fa4f5a0c922be433. after waiting 0 ms 2023-02-09 16:54:01,249 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1675961640805.191a93f3202aa607fa4f5a0c922be433. 2023-02-09 16:54:01,249 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionWithMonthlyPolicy,,1675961640805.191a93f3202aa607fa4f5a0c922be433. 2023-02-09 16:54:01,249 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1557): Region close journal for 191a93f3202aa607fa4f5a0c922be433: Waiting for close lock at 1675961641249Disabling compacts and flushes for region at 1675961641249Disabling writes for close at 1675961641249Writing region close event to WAL at 1675961641249Closed at 1675961641249 2023-02-09 16:54:01,253 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 16:54:01,255 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithMonthlyPolicy,,1675961640805.191a93f3202aa607fa4f5a0c922be433.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1675961641254"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675961641254"}]},"ts":"1675961641254"} 2023-02-09 16:54:01,257 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-09 16:54:01,258 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 16:54:01,258 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675961641258"}]},"ts":"1675961641258"} 2023-02-09 16:54:01,260 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-02-09 16:54:01,263 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=191a93f3202aa607fa4f5a0c922be433, ASSIGN}] 2023-02-09 16:54:01,265 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=191a93f3202aa607fa4f5a0c922be433, ASSIGN 2023-02-09 16:54:01,266 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=191a93f3202aa607fa4f5a0c922be433, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35511,1675961620699; forceNewPlan=false, retain=false 2023-02-09 16:54:01,417 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:01,417 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:01,417 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=191a93f3202aa607fa4f5a0c922be433, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:01,417 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithMonthlyPolicy,,1675961640805.191a93f3202aa607fa4f5a0c922be433.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1675961641417"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675961641417"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675961641417"}]},"ts":"1675961641417"} 2023-02-09 16:54:01,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-09 16:54:01,420 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=20, state=RUNNABLE; OpenRegionProcedure 191a93f3202aa607fa4f5a0c922be433, server=jenkins-hbase4.apache.org,35511,1675961620699}] 2023-02-09 16:54:01,577 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithMonthlyPolicy,,1675961640805.191a93f3202aa607fa4f5a0c922be433. 2023-02-09 16:54:01,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 191a93f3202aa607fa4f5a0c922be433, NAME => 'testMajorCompactionWithMonthlyPolicy,,1675961640805.191a93f3202aa607fa4f5a0c922be433.', STARTKEY => '', ENDKEY => ''} 2023-02-09 16:54:01,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithMonthlyPolicy 191a93f3202aa607fa4f5a0c922be433 2023-02-09 16:54:01,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithMonthlyPolicy,,1675961640805.191a93f3202aa607fa4f5a0c922be433.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 16:54:01,578 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 191a93f3202aa607fa4f5a0c922be433 2023-02-09 16:54:01,578 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 191a93f3202aa607fa4f5a0c922be433 2023-02-09 16:54:01,579 INFO [StoreOpener-191a93f3202aa607fa4f5a0c922be433-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 191a93f3202aa607fa4f5a0c922be433 2023-02-09 16:54:01,581 DEBUG [StoreOpener-191a93f3202aa607fa4f5a0c922be433-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1 2023-02-09 16:54:01,581 DEBUG [StoreOpener-191a93f3202aa607fa4f5a0c922be433-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1 2023-02-09 16:54:01,582 INFO [StoreOpener-191a93f3202aa607fa4f5a0c922be433-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 191a93f3202aa607fa4f5a0c922be433 columnFamilyName family1 2023-02-09 16:54:01,584 INFO [StoreOpener-191a93f3202aa607fa4f5a0c922be433-1] regionserver.HStore(310): Store=191a93f3202aa607fa4f5a0c922be433/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 16:54:01,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433 2023-02-09 16:54:01,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433 2023-02-09 16:54:01,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 191a93f3202aa607fa4f5a0c922be433 2023-02-09 16:54:01,590 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 16:54:01,590 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 191a93f3202aa607fa4f5a0c922be433; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68126035, jitterRate=0.015157029032707214}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 16:54:01,590 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 191a93f3202aa607fa4f5a0c922be433: Running coprocessor pre-open hook at 1675961641578Writing region info on filesystem at 1675961641578Initializing all the Stores at 1675961641579 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} at 1675961641579Cleaning up temporary data from old regions at 1675961641586 (+7 ms)Cleaning up detritus from prior splits at 1675961641586Running coprocessor post-open hooks at 1675961641590 (+4 ms)Region opened successfully at 1675961641590 2023-02-09 16:54:01,591 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithMonthlyPolicy,,1675961640805.191a93f3202aa607fa4f5a0c922be433., pid=21, masterSystemTime=1675961641572 2023-02-09 16:54:01,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithMonthlyPolicy,,1675961640805.191a93f3202aa607fa4f5a0c922be433. 2023-02-09 16:54:01,593 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithMonthlyPolicy,,1675961640805.191a93f3202aa607fa4f5a0c922be433. 2023-02-09 16:54:01,594 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=191a93f3202aa607fa4f5a0c922be433, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:01,594 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithMonthlyPolicy,,1675961640805.191a93f3202aa607fa4f5a0c922be433.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1675961641594"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675961641594"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675961641594"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675961641594"}]},"ts":"1675961641594"} 2023-02-09 16:54:01,599 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=20 2023-02-09 16:54:01,599 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=20, state=SUCCESS; OpenRegionProcedure 191a93f3202aa607fa4f5a0c922be433, server=jenkins-hbase4.apache.org,35511,1675961620699 in 177 msec 2023-02-09 16:54:01,601 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=20, resume processing ppid=19 2023-02-09 16:54:01,601 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=19, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=191a93f3202aa607fa4f5a0c922be433, ASSIGN in 336 msec 2023-02-09 16:54:01,602 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 16:54:01,602 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675961641602"}]},"ts":"1675961641602"} 2023-02-09 16:54:01,604 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-02-09 16:54:01,607 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 16:54:01,608 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy in 802 msec 2023-02-09 16:54:01,919 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:01,919 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:01,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-09 16:54:01,920 INFO [Listener at localhost/41619] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithMonthlyPolicy, procId: 19 completed 2023-02-09 16:54:01,960 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:01,960 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:01,961 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:54:01,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:01,963 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-09 16:54:01,963 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:01,964 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-09 16:54:01,964 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-09 16:54:01,965 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:01,965 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:01,968 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:01,968 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:01,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:01,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:01,968 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:01,968 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:54:01,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:01,969 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:01,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:54:01,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:01,969 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:01,970 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:01,970 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-09 16:54:01,970 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:01,971 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-09 16:54:01,971 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 16:54:01,971 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:54:01,971 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1675961640805.191a93f3202aa607fa4f5a0c922be433. 2023-02-09 16:54:01,971 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1675961640805.191a93f3202aa607fa4f5a0c922be433. started... 2023-02-09 16:54:01,972 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 191a93f3202aa607fa4f5a0c922be433 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-09 16:54:02,401 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511300740ec5c33054c5d9505df086d577121 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511300740ec5c33054c5d9505df086d577121 2023-02-09 16:54:02,405 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/.tmp/family1/6cce2f7dc2f64372921d0b3626b05b08 2023-02-09 16:54:02,412 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/.tmp/family1/6cce2f7dc2f64372921d0b3626b05b08 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/6cce2f7dc2f64372921d0b3626b05b08 2023-02-09 16:54:02,419 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/6cce2f7dc2f64372921d0b3626b05b08, entries=1000, sequenceid=5, filesize=166.0 K 2023-02-09 16:54:02,420 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 191a93f3202aa607fa4f5a0c922be433 in 448ms, sequenceid=5, compaction requested=false 2023-02-09 16:54:02,421 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithMonthlyPolicy' 2023-02-09 16:54:02,422 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 191a93f3202aa607fa4f5a0c922be433: 2023-02-09 16:54:02,422 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1675961640805.191a93f3202aa607fa4f5a0c922be433. 2023-02-09 16:54:02,422 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 16:54:02,422 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 16:54:02,422 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:02,422 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-09 16:54:02,422 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-09 16:54:02,424 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:02,424 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:02,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:02,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:02,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:02,425 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:02,425 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:54:02,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:02,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:02,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:02,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:02,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:02,426 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-09 16:54:02,426 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2d32a9c9[Count = 0] remaining members to acquire global barrier 2023-02-09 16:54:02,426 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-09 16:54:02,427 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:02,428 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:02,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:02,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:02,428 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-09 16:54:02,428 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-09 16:54:02,428 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:54:02,428 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:02,428 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:54:02,430 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:02,430 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-09 16:54:02,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:02,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:02,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:02,430 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:02,430 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-09 16:54:02,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:02,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:02,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:02,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:02,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:02,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:02,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:02,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:54:02,435 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-09 16:54:02,435 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-09 16:54:02,435 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:54:02,435 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:54:02,435 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:02,435 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:54:02,438 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:02,438 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:02,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:02,438 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:02,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:02,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:02,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:02,438 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:02,439 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:02,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:02,439 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:02,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:02,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:02,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:02,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:02,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:02,441 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:02,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:02,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:02,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:02,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:02,444 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:02,444 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:02,444 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:02,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:02,444 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:02,444 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:02,444 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:02,444 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:02,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:02,445 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:02,445 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:02,445 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:02,445 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-09 16:54:02,445 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:54:02,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:02,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:02,446 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 16:54:02,446 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-09 16:54:02,446 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:54:02,546 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:54:02,547 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:02,547 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:02,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:54:02,555 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:02,555 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:02,556 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:54:02,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 16:54:02,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:02,558 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-09 16:54:02,558 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:02,559 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-09 16:54:02,559 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-09 16:54:02,560 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:02,560 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:02,561 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:02,561 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:02,561 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:02,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:02,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:02,562 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:02,562 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:54:02,563 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:02,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:54:02,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:02,563 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:02,564 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-09 16:54:02,564 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:02,564 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-09 16:54:02,564 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:02,565 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-09 16:54:02,565 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 16:54:02,565 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:54:02,565 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1675961640805.191a93f3202aa607fa4f5a0c922be433. 2023-02-09 16:54:02,565 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1675961640805.191a93f3202aa607fa4f5a0c922be433. started... 2023-02-09 16:54:02,565 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 191a93f3202aa607fa4f5a0c922be433 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-09 16:54:02,583 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112840a7e4ab144c4a25bb114519592c0408 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015112840a7e4ab144c4a25bb114519592c0408 2023-02-09 16:54:02,990 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/.tmp/family1/596d991a9c754e9b9e538090a8327c88 2023-02-09 16:54:02,998 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/.tmp/family1/596d991a9c754e9b9e538090a8327c88 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/596d991a9c754e9b9e538090a8327c88 2023-02-09 16:54:03,004 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/596d991a9c754e9b9e538090a8327c88, entries=1, sequenceid=9, filesize=5.0 K 2023-02-09 16:54:03,006 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 191a93f3202aa607fa4f5a0c922be433 in 441ms, sequenceid=9, compaction requested=false 2023-02-09 16:54:03,006 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 191a93f3202aa607fa4f5a0c922be433: 2023-02-09 16:54:03,006 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1675961640805.191a93f3202aa607fa4f5a0c922be433. 2023-02-09 16:54:03,006 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 16:54:03,006 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 16:54:03,006 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:03,006 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-09 16:54:03,006 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-09 16:54:03,008 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:03,008 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:03,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:03,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:03,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:03,008 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:03,008 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:54:03,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:03,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:03,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:03,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:03,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:03,010 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-09 16:54:03,010 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@583a6a7f[Count = 0] remaining members to acquire global barrier 2023-02-09 16:54:03,010 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-09 16:54:03,010 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:03,012 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:03,012 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:03,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:03,012 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-09 16:54:03,012 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:03,012 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:54:03,012 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-09 16:54:03,012 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:54:03,014 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:03,014 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-09 16:54:03,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:03,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:03,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:03,014 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:03,014 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-09 16:54:03,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:03,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:03,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:03,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:03,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:03,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:03,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:03,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:54:03,018 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-09 16:54:03,018 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-09 16:54:03,018 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:54:03,018 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:54:03,018 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:03,018 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:54:03,021 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:03,021 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:03,021 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:03,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:03,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:03,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:03,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:03,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:03,021 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:03,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:03,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:03,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:03,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:03,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:03,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:03,023 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:03,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:03,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:03,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:03,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:03,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:03,029 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:03,029 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:03,029 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:03,029 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:03,029 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:03,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:03,029 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:03,029 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:03,029 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:03,029 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:03,029 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:03,029 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:03,029 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-09 16:54:03,030 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:54:03,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:03,030 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 16:54:03,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:03,031 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:54:03,031 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-09 16:54:03,131 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:54:03,131 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:03,131 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:03,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:54:03,137 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:03,137 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:03,138 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:54:03,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 16:54:03,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:03,140 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-09 16:54:03,141 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:03,141 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-09 16:54:03,141 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-09 16:54:03,142 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:03,142 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:03,143 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:03,143 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:03,143 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:03,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:03,143 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:03,144 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:54:03,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:03,144 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:03,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:54:03,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:03,144 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:03,145 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-09 16:54:03,145 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:03,145 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-09 16:54:03,145 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:03,145 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-09 16:54:03,146 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 16:54:03,146 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:54:03,146 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1675961640805.191a93f3202aa607fa4f5a0c922be433. 2023-02-09 16:54:03,146 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1675961640805.191a93f3202aa607fa4f5a0c922be433. started... 2023-02-09 16:54:03,146 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 191a93f3202aa607fa4f5a0c922be433 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 16:54:03,567 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120132ceb5ec38da496b90c210d446bd5394 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015120132ceb5ec38da496b90c210d446bd5394 2023-02-09 16:54:03,974 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/.tmp/family1/deb84c45cf7048479988be55e4b53f77 2023-02-09 16:54:03,982 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/.tmp/family1/deb84c45cf7048479988be55e4b53f77 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/deb84c45cf7048479988be55e4b53f77 2023-02-09 16:54:03,989 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/deb84c45cf7048479988be55e4b53f77, entries=1, sequenceid=13, filesize=4.9 K 2023-02-09 16:54:03,990 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 191a93f3202aa607fa4f5a0c922be433 in 844ms, sequenceid=13, compaction requested=true 2023-02-09 16:54:03,991 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 191a93f3202aa607fa4f5a0c922be433: 2023-02-09 16:54:03,991 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1675961640805.191a93f3202aa607fa4f5a0c922be433. 2023-02-09 16:54:03,991 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 16:54:03,991 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 16:54:03,991 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:03,991 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-09 16:54:03,991 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-09 16:54:04,026 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:04,026 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:04,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:04,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:04,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:04,026 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:04,026 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:54:04,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:04,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:04,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:04,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:04,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:04,028 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-09 16:54:04,028 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@68e18678[Count = 0] remaining members to acquire global barrier 2023-02-09 16:54:04,028 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-09 16:54:04,028 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:04,111 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:04,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:04,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:04,111 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-09 16:54:04,111 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-09 16:54:04,111 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:54:04,111 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:04,111 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:54:04,172 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-09 16:54:04,172 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:04,172 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:04,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:04,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:04,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:04,173 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-09 16:54:04,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:04,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:04,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:04,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:04,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:04,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:04,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:04,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:54:04,177 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-09 16:54:04,177 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-09 16:54:04,177 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:54:04,177 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:54:04,177 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:04,177 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:54:04,234 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:04,234 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:04,235 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:04,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:04,234 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:04,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:04,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:04,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:04,235 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:04,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:04,235 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:04,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:04,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:04,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:04,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:04,237 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:04,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:04,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:04,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:04,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:04,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:04,326 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:04,326 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:04,326 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:04,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:04,326 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-09 16:54:04,327 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:54:04,326 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:04,327 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 16:54:04,327 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:54:04,328 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:04,328 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:04,328 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:04,328 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:04,328 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:04,328 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:04,329 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-09 16:54:04,329 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:04,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:04,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:04,427 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:54:04,428 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:04,428 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:04,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:54:04,434 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:04,434 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:04,435 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:54:04,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 16:54:04,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:04,442 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-09 16:54:04,442 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:04,443 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-09 16:54:04,443 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-09 16:54:04,448 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:04,448 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:04,518 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:04,518 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:04,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:04,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:04,519 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:04,519 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:54:04,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:04,519 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:04,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:54:04,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:04,520 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:04,520 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-09 16:54:04,520 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:04,520 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-09 16:54:04,520 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:04,521 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-09 16:54:04,521 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 16:54:04,521 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:54:04,521 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1675961640805.191a93f3202aa607fa4f5a0c922be433. 2023-02-09 16:54:04,521 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1675961640805.191a93f3202aa607fa4f5a0c922be433. started... 2023-02-09 16:54:04,522 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 191a93f3202aa607fa4f5a0c922be433 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 16:54:04,948 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205d8c62569dd3a4472867603fff396055f to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205d8c62569dd3a4472867603fff396055f 2023-02-09 16:54:04,952 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-09 16:54:05,368 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/.tmp/family1/cdcc20e30b1d4bfb817916bc89d3b89e 2023-02-09 16:54:05,374 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/.tmp/family1/cdcc20e30b1d4bfb817916bc89d3b89e as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/cdcc20e30b1d4bfb817916bc89d3b89e 2023-02-09 16:54:05,424 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/cdcc20e30b1d4bfb817916bc89d3b89e, entries=1, sequenceid=17, filesize=4.9 K 2023-02-09 16:54:05,425 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 191a93f3202aa607fa4f5a0c922be433 in 903ms, sequenceid=17, compaction requested=true 2023-02-09 16:54:05,425 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 191a93f3202aa607fa4f5a0c922be433: 2023-02-09 16:54:05,425 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1675961640805.191a93f3202aa607fa4f5a0c922be433. 2023-02-09 16:54:05,426 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 16:54:05,426 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 16:54:05,426 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:05,426 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-09 16:54:05,426 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-09 16:54:05,441 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:05,441 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:05,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:05,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:05,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:05,442 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:05,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:05,442 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:54:05,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:05,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:05,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:05,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:05,443 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-09 16:54:05,443 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@8bd67ba[Count = 0] remaining members to acquire global barrier 2023-02-09 16:54:05,443 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-09 16:54:05,443 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:05,488 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:05,488 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:05,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:05,489 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-09 16:54:05,489 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-09 16:54:05,489 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:54:05,489 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:05,489 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:54:05,495 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-09 16:54:05,495 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:05,495 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:05,495 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-09 16:54:05,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:05,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:05,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:05,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:05,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:05,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:05,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:05,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:05,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:05,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:05,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:54:05,499 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-09 16:54:05,499 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-09 16:54:05,499 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:54:05,499 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:54:05,499 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:05,499 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:54:05,503 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:05,503 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:05,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:05,503 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:05,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:05,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:05,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:05,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:05,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:05,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:05,503 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:05,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:05,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:05,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:05,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:05,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:05,505 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:05,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:05,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:05,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:05,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:05,510 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:05,510 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:05,510 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:05,511 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:05,511 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-09 16:54:05,511 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:05,511 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-09 16:54:05,511 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:54:05,511 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:05,511 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:05,511 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:05,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:05,512 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:05,512 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 16:54:05,512 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:54:05,512 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:05,512 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:05,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:05,512 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:05,612 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:54:05,612 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:05,612 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:05,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:54:05,618 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:05,618 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:05,618 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:54:05,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 16:54:05,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:05,621 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-09 16:54:05,621 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:05,621 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-09 16:54:05,621 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-09 16:54:05,622 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:05,622 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:05,624 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:05,624 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:05,624 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:05,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:05,624 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:05,624 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:54:05,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:05,625 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:05,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:54:05,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:05,625 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:05,626 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-09 16:54:05,626 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:05,626 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-09 16:54:05,626 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:05,627 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-09 16:54:05,627 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 16:54:05,627 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:54:05,627 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1675961640805.191a93f3202aa607fa4f5a0c922be433. 2023-02-09 16:54:05,627 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1675961640805.191a93f3202aa607fa4f5a0c922be433. started... 2023-02-09 16:54:05,627 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 191a93f3202aa607fa4f5a0c922be433 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 16:54:06,051 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512284b98b5c5fd2a48d7996186eb9e23d53a to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512284b98b5c5fd2a48d7996186eb9e23d53a 2023-02-09 16:54:06,458 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/.tmp/family1/d3cc3239778a4668bbe694906fbd1f8d 2023-02-09 16:54:06,464 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/.tmp/family1/d3cc3239778a4668bbe694906fbd1f8d as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/d3cc3239778a4668bbe694906fbd1f8d 2023-02-09 16:54:06,469 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/d3cc3239778a4668bbe694906fbd1f8d, entries=1, sequenceid=21, filesize=4.9 K 2023-02-09 16:54:06,470 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 191a93f3202aa607fa4f5a0c922be433 in 843ms, sequenceid=21, compaction requested=true 2023-02-09 16:54:06,470 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 191a93f3202aa607fa4f5a0c922be433: 2023-02-09 16:54:06,470 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1675961640805.191a93f3202aa607fa4f5a0c922be433. 2023-02-09 16:54:06,470 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 16:54:06,470 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 16:54:06,470 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:06,471 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-09 16:54:06,471 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-09 16:54:06,472 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:06,472 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:06,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:06,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:06,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:06,473 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:06,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:06,473 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:54:06,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:06,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:06,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:06,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:06,474 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-09 16:54:06,474 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@30f9fb85[Count = 0] remaining members to acquire global barrier 2023-02-09 16:54:06,474 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-09 16:54:06,474 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:06,475 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:06,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:06,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:06,475 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-09 16:54:06,475 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-09 16:54:06,475 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:54:06,475 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:06,475 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:54:06,478 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-09 16:54:06,478 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:06,478 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:06,478 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-09 16:54:06,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:06,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:06,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:06,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:06,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:06,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:06,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:06,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:06,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:06,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:06,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:54:06,481 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-09 16:54:06,481 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-09 16:54:06,481 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:54:06,481 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:54:06,481 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:06,481 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:54:06,485 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:06,485 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:06,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:06,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:06,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:06,485 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:06,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:06,485 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:06,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:06,486 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:06,486 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:06,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:06,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:06,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:06,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:06,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:06,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:06,490 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:06,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:06,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:06,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:06,492 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:06,492 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:06,493 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:06,493 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:06,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:06,493 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-09 16:54:06,493 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:54:06,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:06,493 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:06,493 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:06,493 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:06,493 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:06,494 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:06,494 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:06,494 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 16:54:06,494 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:54:06,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:06,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:06,594 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:54:06,594 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:06,594 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:06,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:54:06,599 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:06,599 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:06,600 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:54:06,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 16:54:06,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:06,601 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-09 16:54:06,601 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:06,602 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-09 16:54:06,602 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-09 16:54:06,602 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:06,602 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:06,605 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:06,605 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:06,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:06,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:06,605 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:06,605 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:54:06,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:06,606 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:06,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:54:06,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:06,606 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:06,606 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-09 16:54:06,606 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:06,606 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-09 16:54:06,606 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:06,607 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-09 16:54:06,607 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 16:54:06,607 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:54:06,607 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1675961640805.191a93f3202aa607fa4f5a0c922be433. 2023-02-09 16:54:06,607 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1675961640805.191a93f3202aa607fa4f5a0c922be433. started... 2023-02-09 16:54:06,607 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 191a93f3202aa607fa4f5a0c922be433 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 16:54:06,621 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231ab0d3459826144ff95eac404f522f0c0 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231ab0d3459826144ff95eac404f522f0c0 2023-02-09 16:54:07,030 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/.tmp/family1/4a20b9e3ec1b4026a8249e9350d2f69f 2023-02-09 16:54:07,036 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/.tmp/family1/4a20b9e3ec1b4026a8249e9350d2f69f as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/4a20b9e3ec1b4026a8249e9350d2f69f 2023-02-09 16:54:07,042 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/4a20b9e3ec1b4026a8249e9350d2f69f, entries=1, sequenceid=25, filesize=4.9 K 2023-02-09 16:54:07,043 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 191a93f3202aa607fa4f5a0c922be433 in 436ms, sequenceid=25, compaction requested=true 2023-02-09 16:54:07,043 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 191a93f3202aa607fa4f5a0c922be433: 2023-02-09 16:54:07,043 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1675961640805.191a93f3202aa607fa4f5a0c922be433. 2023-02-09 16:54:07,043 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 16:54:07,043 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 16:54:07,043 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:07,043 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-09 16:54:07,043 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-09 16:54:07,045 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:07,045 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:07,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:07,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:07,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:07,045 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:07,045 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:54:07,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:07,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:07,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:07,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:07,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:07,047 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-09 16:54:07,047 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3b9b0677[Count = 0] remaining members to acquire global barrier 2023-02-09 16:54:07,047 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-09 16:54:07,047 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:07,049 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:07,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:07,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:07,049 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-09 16:54:07,049 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-09 16:54:07,049 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:54:07,049 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:07,049 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:54:07,051 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-09 16:54:07,051 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:07,051 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:07,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:07,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:07,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:07,051 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-09 16:54:07,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:07,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:07,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:07,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:07,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:07,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:07,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:07,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:54:07,055 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-09 16:54:07,055 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-09 16:54:07,055 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:54:07,055 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:54:07,055 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:07,055 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:54:07,058 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:07,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:07,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:07,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:07,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:07,058 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:07,059 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:07,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:07,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:07,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:07,059 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:07,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:07,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:07,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:07,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:07,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:07,060 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:07,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:07,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:07,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:07,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:07,062 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:07,062 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:07,062 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:07,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:07,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:07,063 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:07,063 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-09 16:54:07,062 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:07,063 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-09 16:54:07,064 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:54:07,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:07,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:07,063 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:07,064 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:07,064 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:07,064 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:07,064 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:07,064 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 16:54:07,064 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:54:07,164 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:54:07,164 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:07,164 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:07,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:54:07,169 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:07,170 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:07,170 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:54:07,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 16:54:07,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:07,172 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-09 16:54:07,172 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:07,173 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-09 16:54:07,173 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-09 16:54:07,173 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:07,173 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:07,175 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:07,175 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:07,175 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:07,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:07,175 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:07,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:07,175 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:54:07,175 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:07,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:54:07,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:07,176 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:07,176 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-09 16:54:07,176 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:07,176 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-09 16:54:07,176 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:07,177 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-09 16:54:07,177 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 16:54:07,177 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:54:07,177 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1675961640805.191a93f3202aa607fa4f5a0c922be433. 2023-02-09 16:54:07,177 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1675961640805.191a93f3202aa607fa4f5a0c922be433. started... 2023-02-09 16:54:07,177 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 191a93f3202aa607fa4f5a0c922be433 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 16:54:07,594 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601014eceef96067a4fe98c1545944cceaf0b to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601014eceef96067a4fe98c1545944cceaf0b 2023-02-09 16:54:08,001 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/.tmp/family1/9dca346efcf4434abb82c84c1aa93ca8 2023-02-09 16:54:08,008 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/.tmp/family1/9dca346efcf4434abb82c84c1aa93ca8 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/9dca346efcf4434abb82c84c1aa93ca8 2023-02-09 16:54:08,014 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/9dca346efcf4434abb82c84c1aa93ca8, entries=1, sequenceid=29, filesize=4.9 K 2023-02-09 16:54:08,015 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 191a93f3202aa607fa4f5a0c922be433 in 838ms, sequenceid=29, compaction requested=true 2023-02-09 16:54:08,015 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 191a93f3202aa607fa4f5a0c922be433: 2023-02-09 16:54:08,015 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1675961640805.191a93f3202aa607fa4f5a0c922be433. 2023-02-09 16:54:08,015 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 16:54:08,015 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 16:54:08,015 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:08,015 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-09 16:54:08,015 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-09 16:54:08,017 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:08,017 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:08,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:08,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:08,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:08,017 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:08,017 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:54:08,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:08,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:08,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:08,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:08,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:08,019 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-09 16:54:08,019 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5fad953a[Count = 0] remaining members to acquire global barrier 2023-02-09 16:54:08,019 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-09 16:54:08,019 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:08,022 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:08,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:08,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:08,022 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-09 16:54:08,022 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:08,022 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:54:08,022 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-09 16:54:08,022 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:54:08,023 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:08,023 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-09 16:54:08,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:08,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:08,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:08,023 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:08,023 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-09 16:54:08,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:08,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:08,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:08,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:08,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:08,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:08,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:08,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:54:08,026 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-09 16:54:08,026 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-09 16:54:08,026 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:54:08,026 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:54:08,026 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:08,026 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:54:08,028 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:08,028 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:08,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:08,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:08,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:08,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:08,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:08,028 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:08,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:08,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:08,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:08,029 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:08,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:08,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:08,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:08,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:08,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:08,030 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:08,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:08,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:08,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:08,039 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:08,039 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:08,039 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:08,039 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-09 16:54:08,039 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:54:08,039 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:08,039 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:08,039 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:08,039 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:08,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:08,039 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:08,040 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:08,040 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 16:54:08,040 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:08,040 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:54:08,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:08,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:08,040 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:08,141 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:54:08,141 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:08,141 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:08,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:54:08,148 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:08,148 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:08,149 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:54:08,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 16:54:08,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:08,151 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-09 16:54:08,151 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:08,151 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-09 16:54:08,151 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-09 16:54:08,152 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:08,152 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:08,153 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:08,153 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:08,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:08,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:08,153 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:08,153 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:54:08,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:08,154 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:08,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:54:08,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:08,154 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:08,155 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-09 16:54:08,155 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:08,155 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-09 16:54:08,155 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:08,155 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-09 16:54:08,155 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 16:54:08,156 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:54:08,156 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1675961640805.191a93f3202aa607fa4f5a0c922be433. 2023-02-09 16:54:08,156 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1675961640805.191a93f3202aa607fa4f5a0c922be433. started... 2023-02-09 16:54:08,156 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 191a93f3202aa607fa4f5a0c922be433 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 16:54:08,572 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601034be3965de0744d329e8197f65e09df72 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601034be3965de0744d329e8197f65e09df72 2023-02-09 16:54:08,580 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/.tmp/family1/fec8945026a0466ebc825ab8656380fd 2023-02-09 16:54:08,586 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/.tmp/family1/fec8945026a0466ebc825ab8656380fd as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/fec8945026a0466ebc825ab8656380fd 2023-02-09 16:54:08,592 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/fec8945026a0466ebc825ab8656380fd, entries=1, sequenceid=33, filesize=4.9 K 2023-02-09 16:54:08,593 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 191a93f3202aa607fa4f5a0c922be433 in 437ms, sequenceid=33, compaction requested=true 2023-02-09 16:54:08,593 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 191a93f3202aa607fa4f5a0c922be433: 2023-02-09 16:54:08,593 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1675961640805.191a93f3202aa607fa4f5a0c922be433. 2023-02-09 16:54:08,593 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 16:54:08,593 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 16:54:08,593 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:08,593 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-09 16:54:08,593 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-09 16:54:08,595 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:08,595 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:08,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:08,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:08,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:08,595 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:08,595 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:54:08,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:08,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:08,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:08,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:08,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:08,597 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-09 16:54:08,597 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3cceb9c2[Count = 0] remaining members to acquire global barrier 2023-02-09 16:54:08,597 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-09 16:54:08,597 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:08,598 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:08,598 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:08,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:08,599 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-09 16:54:08,599 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-09 16:54:08,599 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:54:08,599 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:08,599 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:54:08,604 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-09 16:54:08,604 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:08,604 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:08,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:08,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:08,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:08,604 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-09 16:54:08,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:08,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:08,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:08,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:08,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:08,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:08,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:08,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:54:08,607 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-09 16:54:08,607 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-09 16:54:08,607 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:54:08,607 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:54:08,607 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:08,607 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:54:08,609 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:08,609 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:08,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:08,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:08,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:08,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:08,609 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:08,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:08,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:08,610 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:08,610 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:08,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:08,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:08,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:08,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:08,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:08,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:08,615 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:08,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:08,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:08,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:08,617 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:08,617 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:08,617 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:08,617 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:08,617 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:08,617 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-09 16:54:08,617 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:54:08,617 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:08,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:08,617 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:08,617 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:08,618 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:08,618 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:08,618 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:08,618 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 16:54:08,618 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:54:08,619 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:08,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:08,718 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:54:08,719 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:08,719 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:08,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:54:08,724 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:08,724 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:08,724 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:54:08,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 16:54:08,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:08,728 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-09 16:54:08,728 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:08,728 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-09 16:54:08,728 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-09 16:54:08,729 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:08,729 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:08,730 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:08,730 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:08,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:08,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:08,730 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:08,730 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:54:08,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:08,731 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:08,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:54:08,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:08,732 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:08,732 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-09 16:54:08,732 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:08,732 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-09 16:54:08,732 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:08,732 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-09 16:54:08,733 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 16:54:08,733 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:54:08,733 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1675961640805.191a93f3202aa607fa4f5a0c922be433. 2023-02-09 16:54:08,733 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1675961640805.191a93f3202aa607fa4f5a0c922be433. started... 2023-02-09 16:54:08,733 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 191a93f3202aa607fa4f5a0c922be433 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 16:54:09,152 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509079a034840cd8b48e5a6ade69cba100820 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201509079a034840cd8b48e5a6ade69cba100820 2023-02-09 16:54:09,560 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/.tmp/family1/3c4d005c50754e2bbbdf1ba4a589989b 2023-02-09 16:54:09,566 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/.tmp/family1/3c4d005c50754e2bbbdf1ba4a589989b as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/3c4d005c50754e2bbbdf1ba4a589989b 2023-02-09 16:54:09,572 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/3c4d005c50754e2bbbdf1ba4a589989b, entries=1, sequenceid=37, filesize=4.9 K 2023-02-09 16:54:09,573 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 191a93f3202aa607fa4f5a0c922be433 in 840ms, sequenceid=37, compaction requested=true 2023-02-09 16:54:09,573 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 191a93f3202aa607fa4f5a0c922be433: 2023-02-09 16:54:09,573 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1675961640805.191a93f3202aa607fa4f5a0c922be433. 2023-02-09 16:54:09,573 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 16:54:09,573 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 16:54:09,573 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:09,573 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-09 16:54:09,573 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-09 16:54:09,575 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:09,575 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:09,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:09,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:09,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:09,575 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:09,576 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:54:09,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:09,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:09,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:09,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:09,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:09,577 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-09 16:54:09,577 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4314480d[Count = 0] remaining members to acquire global barrier 2023-02-09 16:54:09,577 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-09 16:54:09,577 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:09,579 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:09,579 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:09,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:09,579 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-09 16:54:09,580 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-09 16:54:09,580 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:54:09,580 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:09,580 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:54:09,581 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-09 16:54:09,581 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:09,581 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-09 16:54:09,582 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:09,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:09,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:09,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:09,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:09,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:09,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:09,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:09,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:09,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:09,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:09,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:54:09,585 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-09 16:54:09,585 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-09 16:54:09,585 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:54:09,585 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:54:09,585 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:09,585 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:54:09,586 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:09,586 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:09,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:09,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:09,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:09,586 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:09,586 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:09,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:09,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:09,587 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:09,587 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:09,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:09,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:09,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:09,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:09,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:09,588 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:09,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:09,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:09,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:09,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:09,591 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:09,591 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:09,591 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:09,591 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:09,591 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:09,591 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-09 16:54:09,591 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:54:09,591 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:09,591 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:09,591 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:09,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:09,592 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:09,592 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 16:54:09,592 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:54:09,592 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:09,592 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:09,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:09,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:09,692 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:54:09,693 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:09,693 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:09,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:54:09,698 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:09,698 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:09,698 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:54:09,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 16:54:09,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:09,700 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-09 16:54:09,700 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:09,701 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-09 16:54:09,701 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-09 16:54:09,702 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:09,702 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:09,703 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:09,703 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:09,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:09,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:09,703 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:09,703 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:54:09,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:09,704 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:09,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:54:09,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:09,704 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:09,705 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-09 16:54:09,705 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:09,705 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-09 16:54:09,705 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:09,706 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-09 16:54:09,706 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 16:54:09,706 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:54:09,707 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1675961640805.191a93f3202aa607fa4f5a0c922be433. 2023-02-09 16:54:09,707 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1675961640805.191a93f3202aa607fa4f5a0c922be433. started... 2023-02-09 16:54:09,707 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 191a93f3202aa607fa4f5a0c922be433 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 16:54:10,125 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120a80ada66fc4d4680861adb13c7fbf092 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120a80ada66fc4d4680861adb13c7fbf092 2023-02-09 16:54:10,531 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/.tmp/family1/70e45f46ca2648d7a88ae18a8aa74fd3 2023-02-09 16:54:10,538 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/.tmp/family1/70e45f46ca2648d7a88ae18a8aa74fd3 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/70e45f46ca2648d7a88ae18a8aa74fd3 2023-02-09 16:54:10,543 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/70e45f46ca2648d7a88ae18a8aa74fd3, entries=1, sequenceid=41, filesize=4.9 K 2023-02-09 16:54:10,544 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 191a93f3202aa607fa4f5a0c922be433 in 837ms, sequenceid=41, compaction requested=true 2023-02-09 16:54:10,544 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 191a93f3202aa607fa4f5a0c922be433: 2023-02-09 16:54:10,544 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1675961640805.191a93f3202aa607fa4f5a0c922be433. 2023-02-09 16:54:10,544 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 16:54:10,544 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 16:54:10,544 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:10,544 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-09 16:54:10,544 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-09 16:54:10,546 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:10,546 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:10,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:10,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:10,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:10,547 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:10,547 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:54:10,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:10,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:10,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:10,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:10,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:10,548 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-09 16:54:10,548 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@205f46a6[Count = 0] remaining members to acquire global barrier 2023-02-09 16:54:10,548 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-09 16:54:10,548 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:10,550 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:10,551 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:10,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:10,551 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-09 16:54:10,551 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-09 16:54:10,551 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:54:10,551 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:10,551 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:54:10,552 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:10,552 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-09 16:54:10,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:10,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:10,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:10,552 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:10,553 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-09 16:54:10,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:10,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:10,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:10,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:10,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:10,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:10,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:10,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:54:10,555 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-09 16:54:10,555 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-09 16:54:10,556 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:54:10,556 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:54:10,556 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:10,556 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:54:10,557 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:10,557 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:10,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:10,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:10,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:10,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:10,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:10,557 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:10,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:10,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:10,558 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:10,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:10,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:10,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:10,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:10,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:10,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:10,559 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:10,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:10,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:10,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:10,561 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:10,561 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:10,561 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:10,561 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:10,561 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:10,562 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-09 16:54:10,561 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:10,561 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:10,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:10,561 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-09 16:54:10,563 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:54:10,561 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:10,563 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:10,563 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:10,563 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:10,563 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:10,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:10,564 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 16:54:10,564 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:54:10,664 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:54:10,664 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:10,664 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:10,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:54:10,666 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=41333] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithMonthlyPolicy 2023-02-09 16:54:10,668 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] procedure2.ProcedureExecutor(1029): Stored pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-09 16:54:10,669 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-09 16:54:10,670 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 16:54:10,670 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=22, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675962250670 2023-02-09 16:54:10,671 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-09 16:54:10,673 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithMonthlyPolicy' and column 'family1' 2023-02-09 16:54:10,673 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-09 16:54:10,673 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] zookeeper.ReadOnlyZKClient(139): Connect 0x49106e21 to 127.0.0.1:53887 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 16:54:10,701 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@30dca96a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 16:54:10,702 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-09 16:54:11,149 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010333d6d011f3204d3a858edce1b8dfd4a3 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2016010333d6d011f3204d3a858edce1b8dfd4a3 2023-02-09 16:54:11,150 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-09 16:54:11,165 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 16:54:11,166 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36006, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 16:54:11,173 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:11,174 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:11,174 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-09 16:54:11,175 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42056, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-09 16:54:11,188 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/f4d32cb947674ea2b7acc3da7e67e73c first=Optional[r5] last=Optional[r6] 2023-02-09 16:54:11,189 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1675961640805.191a93f3202aa607fa4f5a0c922be433., hostname=jenkins-hbase4.apache.org,35511,1675961620699, seqNum=2 for row with hfile group [{family1,hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/f4d32cb947674ea2b7acc3da7e67e73c}] 2023-02-09 16:54:11,194 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(763): Validating hfile at hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/f4d32cb947674ea2b7acc3da7e67e73c for inclusion in 191a93f3202aa607fa4f5a0c922be433/family1 2023-02-09 16:54:11,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-02-09 16:54:11,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(777): Region bounds: first= last= 2023-02-09 16:54:11,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HRegion(2445): Flush status journal for 191a93f3202aa607fa4f5a0c922be433: 2023-02-09 16:54:11,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/f4d32cb947674ea2b7acc3da7e67e73c to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionWithMonthlyPolicy__2dmqh9h19c5caf6pnonb86n4un8lk3nfhlb5q3oj0nll06ljub685tkiehmg9v1b/family1/f4d32cb947674ea2b7acc3da7e67e73c 2023-02-09 16:54:11,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionWithMonthlyPolicy__2dmqh9h19c5caf6pnonb86n4un8lk3nfhlb5q3oj0nll06ljub685tkiehmg9v1b/family1/f4d32cb947674ea2b7acc3da7e67e73c as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/4ab0d58be18e4f9ea08c09ed560ba152_SeqId_44_ 2023-02-09 16:54:11,203 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(849): Loaded HFile hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionWithMonthlyPolicy__2dmqh9h19c5caf6pnonb86n4un8lk3nfhlb5q3oj0nll06ljub685tkiehmg9v1b/family1/f4d32cb947674ea2b7acc3da7e67e73c into 191a93f3202aa607fa4f5a0c922be433/family1 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/4ab0d58be18e4f9ea08c09ed560ba152_SeqId_44_ - updating store file list. 2023-02-09 16:54:11,218 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(882): Loaded HFile hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/4ab0d58be18e4f9ea08c09ed560ba152_SeqId_44_ into 191a93f3202aa607fa4f5a0c922be433/family1 2023-02-09 16:54:11,218 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(855): Successfully loaded hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionWithMonthlyPolicy__2dmqh9h19c5caf6pnonb86n4un8lk3nfhlb5q3oj0nll06ljub685tkiehmg9v1b/family1/f4d32cb947674ea2b7acc3da7e67e73c into 191a93f3202aa607fa4f5a0c922be433/family1 (new location: hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/4ab0d58be18e4f9ea08c09ed560ba152_SeqId_44_) 2023-02-09 16:54:11,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionWithMonthlyPolicy__2dmqh9h19c5caf6pnonb86n4un8lk3nfhlb5q3oj0nll06ljub685tkiehmg9v1b/family1/f4d32cb947674ea2b7acc3da7e67e73c 2023-02-09 16:54:11,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-09 16:54:11,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-09 16:54:11,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(1912): 191a93f3202aa607fa4f5a0c922be433/family1 is initiating minor compaction 2023-02-09 16:54:11,224 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 191a93f3202aa607fa4f5a0c922be433/family1 in testMajorCompactionWithMonthlyPolicy,,1675961640805.191a93f3202aa607fa4f5a0c922be433. 2023-02-09 16:54:11,224 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/596d991a9c754e9b9e538090a8327c88, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/deb84c45cf7048479988be55e4b53f77, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/cdcc20e30b1d4bfb817916bc89d3b89e, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/d3cc3239778a4668bbe694906fbd1f8d, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/4a20b9e3ec1b4026a8249e9350d2f69f, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/9dca346efcf4434abb82c84c1aa93ca8, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/fec8945026a0466ebc825ab8656380fd, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/3c4d005c50754e2bbbdf1ba4a589989b, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/70e45f46ca2648d7a88ae18a8aa74fd3, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/4ab0d58be18e4f9ea08c09ed560ba152_SeqId_44_] into tmpdir=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/.tmp, totalSize=49.7 K 2023-02-09 16:54:11,224 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting 596d991a9c754e9b9e538090a8327c88, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-09 16:54:11,224 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting deb84c45cf7048479988be55e4b53f77, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-09 16:54:11,224 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting cdcc20e30b1d4bfb817916bc89d3b89e, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-09 16:54:11,224 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting d3cc3239778a4668bbe694906fbd1f8d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-09 16:54:11,224 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting 4a20b9e3ec1b4026a8249e9350d2f69f, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-09 16:54:11,224 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting 9dca346efcf4434abb82c84c1aa93ca8, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-09 16:54:11,225 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting fec8945026a0466ebc825ab8656380fd, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-09 16:54:11,225 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting 3c4d005c50754e2bbbdf1ba4a589989b, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-09 16:54:11,225 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting 70e45f46ca2648d7a88ae18a8aa74fd3, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-09 16:54:11,225 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting 4ab0d58be18e4f9ea08c09ed560ba152_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-09 16:54:11,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@1e878c1; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 16:54:11,227 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-09 16:54:11,229 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 16:54:11,230 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601014eceef96067a4fe98c1545944cceaf0b to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601014eceef96067a4fe98c1545944cceaf0b 2023-02-09 16:54:11,232 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601034be3965de0744d329e8197f65e09df72 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601034be3965de0744d329e8197f65e09df72 2023-02-09 16:54:11,232 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-02-09 16:54:11,232 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-02-09 16:54:11,233 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-09 16:54:11,233 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-09 16:54:11,282 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] throttle.PressureAwareThroughputController(145): 191a93f3202aa607fa4f5a0c922be433#family1#compaction#22 average throughput is 0.46 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 16:54:11,320 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231fbbf1185ce5c4e3da0e8e554a0fdde5d to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231fbbf1185ce5c4e3da0e8e554a0fdde5d 2023-02-09 16:54:11,321 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-09 16:54:11,340 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:11,340 INFO [MobCompactor-pool-0] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:11,356 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/f59b70e73eff4f72971de7e38ba7ec7d first=Optional[r1] last=Optional[r4] 2023-02-09 16:54:11,357 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1675961640805.191a93f3202aa607fa4f5a0c922be433., hostname=jenkins-hbase4.apache.org,35511,1675961620699, seqNum=2 for row with hfile group [{family1,hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/f59b70e73eff4f72971de7e38ba7ec7d}] 2023-02-09 16:54:11,360 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(763): Validating hfile at hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/f59b70e73eff4f72971de7e38ba7ec7d for inclusion in 191a93f3202aa607fa4f5a0c922be433/family1 2023-02-09 16:54:11,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-02-09 16:54:11,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(777): Region bounds: first= last= 2023-02-09 16:54:11,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HRegion(2445): Flush status journal for 191a93f3202aa607fa4f5a0c922be433: 2023-02-09 16:54:11,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/f59b70e73eff4f72971de7e38ba7ec7d to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionWithMonthlyPolicy__a3m7inal6ep5p9sutfhvej92j3cjlokn067pe0v59o12fum8ko51ejb08saarhdi/family1/f59b70e73eff4f72971de7e38ba7ec7d 2023-02-09 16:54:11,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionWithMonthlyPolicy__a3m7inal6ep5p9sutfhvej92j3cjlokn067pe0v59o12fum8ko51ejb08saarhdi/family1/f59b70e73eff4f72971de7e38ba7ec7d as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/4bdec3b054cb4e279ce0c81b9ff7cfdf_SeqId_46_ 2023-02-09 16:54:11,370 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(849): Loaded HFile hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionWithMonthlyPolicy__a3m7inal6ep5p9sutfhvej92j3cjlokn067pe0v59o12fum8ko51ejb08saarhdi/family1/f59b70e73eff4f72971de7e38ba7ec7d into 191a93f3202aa607fa4f5a0c922be433/family1 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/4bdec3b054cb4e279ce0c81b9ff7cfdf_SeqId_46_ - updating store file list. 2023-02-09 16:54:11,376 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(882): Loaded HFile hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/4bdec3b054cb4e279ce0c81b9ff7cfdf_SeqId_46_ into 191a93f3202aa607fa4f5a0c922be433/family1 2023-02-09 16:54:11,376 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(855): Successfully loaded hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionWithMonthlyPolicy__a3m7inal6ep5p9sutfhvej92j3cjlokn067pe0v59o12fum8ko51ejb08saarhdi/family1/f59b70e73eff4f72971de7e38ba7ec7d into 191a93f3202aa607fa4f5a0c922be433/family1 (new location: hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/4bdec3b054cb4e279ce0c81b9ff7cfdf_SeqId_46_) 2023-02-09 16:54:11,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionWithMonthlyPolicy__a3m7inal6ep5p9sutfhvej92j3cjlokn067pe0v59o12fum8ko51ejb08saarhdi/family1/f59b70e73eff4f72971de7e38ba7ec7d 2023-02-09 16:54:11,379 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-09 16:54:11,380 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 16:54:11,382 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015120132ceb5ec38da496b90c210d446bd5394 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015120132ceb5ec38da496b90c210d446bd5394 2023-02-09 16:54:11,383 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205d8c62569dd3a4472867603fff396055f to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205d8c62569dd3a4472867603fff396055f 2023-02-09 16:54:11,384 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512284b98b5c5fd2a48d7996186eb9e23d53a to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512284b98b5c5fd2a48d7996186eb9e23d53a 2023-02-09 16:54:11,386 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231ab0d3459826144ff95eac404f522f0c0 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231ab0d3459826144ff95eac404f522f0c0 2023-02-09 16:54:11,386 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-02-09 16:54:11,386 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-02-09 16:54:11,386 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-09 16:54:11,387 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-09 16:54:12,103 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/.tmp/family1/def229cbad684671ad617e8d8f9f8965 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/def229cbad684671ad617e8d8f9f8965 2023-02-09 16:54:12,110 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 191a93f3202aa607fa4f5a0c922be433/family1 of 191a93f3202aa607fa4f5a0c922be433 into def229cbad684671ad617e8d8f9f8965(size=6.6 K), total size for store is 178.1 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-09 16:54:12,110 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 191a93f3202aa607fa4f5a0c922be433: 2023-02-09 16:54:12,110 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1675961640805.191a93f3202aa607fa4f5a0c922be433., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1675961651223; duration=0sec 2023-02-09 16:54:12,111 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 16:54:12,157 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/596d991a9c754e9b9e538090a8327c88, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/deb84c45cf7048479988be55e4b53f77, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/cdcc20e30b1d4bfb817916bc89d3b89e, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/d3cc3239778a4668bbe694906fbd1f8d, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/4a20b9e3ec1b4026a8249e9350d2f69f, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/9dca346efcf4434abb82c84c1aa93ca8, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/fec8945026a0466ebc825ab8656380fd, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/3c4d005c50754e2bbbdf1ba4a589989b, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/70e45f46ca2648d7a88ae18a8aa74fd3, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/4ab0d58be18e4f9ea08c09ed560ba152_SeqId_44_] to archive 2023-02-09 16:54:12,159 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 16:54:12,162 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/596d991a9c754e9b9e538090a8327c88 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/596d991a9c754e9b9e538090a8327c88 2023-02-09 16:54:12,163 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/deb84c45cf7048479988be55e4b53f77 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/deb84c45cf7048479988be55e4b53f77 2023-02-09 16:54:12,165 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/cdcc20e30b1d4bfb817916bc89d3b89e to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/cdcc20e30b1d4bfb817916bc89d3b89e 2023-02-09 16:54:12,167 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/d3cc3239778a4668bbe694906fbd1f8d to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/d3cc3239778a4668bbe694906fbd1f8d 2023-02-09 16:54:12,168 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/4a20b9e3ec1b4026a8249e9350d2f69f to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/4a20b9e3ec1b4026a8249e9350d2f69f 2023-02-09 16:54:12,170 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/9dca346efcf4434abb82c84c1aa93ca8 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/9dca346efcf4434abb82c84c1aa93ca8 2023-02-09 16:54:12,176 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/fec8945026a0466ebc825ab8656380fd to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/fec8945026a0466ebc825ab8656380fd 2023-02-09 16:54:12,177 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/3c4d005c50754e2bbbdf1ba4a589989b to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/3c4d005c50754e2bbbdf1ba4a589989b 2023-02-09 16:54:12,179 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/70e45f46ca2648d7a88ae18a8aa74fd3 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/70e45f46ca2648d7a88ae18a8aa74fd3 2023-02-09 16:54:12,181 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/4ab0d58be18e4f9ea08c09ed560ba152_SeqId_44_ to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/4ab0d58be18e4f9ea08c09ed560ba152_SeqId_44_ 2023-02-09 16:54:12,252 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130754db9057f714fb6b586c6275aa6277b to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130754db9057f714fb6b586c6275aa6277b 2023-02-09 16:54:12,253 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-09 16:54:12,274 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:12,274 INFO [MobCompactor-pool-0] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:12,284 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/561e0e6450c642caad28931992f784e1 first=Optional[r00] last=Optional[r8] 2023-02-09 16:54:12,284 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1675961640805.191a93f3202aa607fa4f5a0c922be433., hostname=jenkins-hbase4.apache.org,35511,1675961620699, seqNum=2 for row with hfile group [{family1,hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/561e0e6450c642caad28931992f784e1}] 2023-02-09 16:54:12,287 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(763): Validating hfile at hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/561e0e6450c642caad28931992f784e1 for inclusion in 191a93f3202aa607fa4f5a0c922be433/family1 2023-02-09 16:54:12,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-02-09 16:54:12,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(777): Region bounds: first= last= 2023-02-09 16:54:12,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HRegion(2445): Flush status journal for 191a93f3202aa607fa4f5a0c922be433: 2023-02-09 16:54:12,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/561e0e6450c642caad28931992f784e1 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionWithMonthlyPolicy__mb8kesrd6odugs7ocgnc8ir6a40fjv6h7kn5phqtcb60rkeqoqas4l2jh21si9uv/family1/561e0e6450c642caad28931992f784e1 2023-02-09 16:54:12,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionWithMonthlyPolicy__mb8kesrd6odugs7ocgnc8ir6a40fjv6h7kn5phqtcb60rkeqoqas4l2jh21si9uv/family1/561e0e6450c642caad28931992f784e1 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/8f7c171326b94e83ad39918862441926_SeqId_49_ 2023-02-09 16:54:12,298 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(849): Loaded HFile hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionWithMonthlyPolicy__mb8kesrd6odugs7ocgnc8ir6a40fjv6h7kn5phqtcb60rkeqoqas4l2jh21si9uv/family1/561e0e6450c642caad28931992f784e1 into 191a93f3202aa607fa4f5a0c922be433/family1 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/8f7c171326b94e83ad39918862441926_SeqId_49_ - updating store file list. 2023-02-09 16:54:12,304 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(882): Loaded HFile hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/8f7c171326b94e83ad39918862441926_SeqId_49_ into 191a93f3202aa607fa4f5a0c922be433/family1 2023-02-09 16:54:12,304 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(855): Successfully loaded hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionWithMonthlyPolicy__mb8kesrd6odugs7ocgnc8ir6a40fjv6h7kn5phqtcb60rkeqoqas4l2jh21si9uv/family1/561e0e6450c642caad28931992f784e1 into 191a93f3202aa607fa4f5a0c922be433/family1 (new location: hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/8f7c171326b94e83ad39918862441926_SeqId_49_) 2023-02-09 16:54:12,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionWithMonthlyPolicy__mb8kesrd6odugs7ocgnc8ir6a40fjv6h7kn5phqtcb60rkeqoqas4l2jh21si9uv/family1/561e0e6450c642caad28931992f784e1 2023-02-09 16:54:12,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-02-09 16:54:12,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 352581 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-02-09 16:54:12,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(1912): 191a93f3202aa607fa4f5a0c922be433/family1 is initiating minor compaction (all files) 2023-02-09 16:54:12,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@6483f59; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 16:54:12,306 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 191a93f3202aa607fa4f5a0c922be433/family1 in testMajorCompactionWithMonthlyPolicy,,1675961640805.191a93f3202aa607fa4f5a0c922be433. 2023-02-09 16:54:12,306 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/6cce2f7dc2f64372921d0b3626b05b08, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/def229cbad684671ad617e8d8f9f8965, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/4bdec3b054cb4e279ce0c81b9ff7cfdf_SeqId_46_, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/8f7c171326b94e83ad39918862441926_SeqId_49_] into tmpdir=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/.tmp, totalSize=344.3 K 2023-02-09 16:54:12,307 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting 6cce2f7dc2f64372921d0b3626b05b08, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878845085 2023-02-09 16:54:12,307 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting def229cbad684671ad617e8d8f9f8965, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621245085 2023-02-09 16:54:12,308 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting 4bdec3b054cb4e279ce0c81b9ff7cfdf_SeqId_46_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=47, earliestPutTs=1448965245085 2023-02-09 16:54:12,308 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-09 16:54:12,308 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting 8f7c171326b94e83ad39918862441926_SeqId_49_, keycount=1001, bloomtype=ROW, size=166.2 K, encoding=NONE, compression=NONE, seqNum=50, earliestPutTs=1448014845085 2023-02-09 16:54:12,309 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 16:54:12,312 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120a80ada66fc4d4680861adb13c7fbf092 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120a80ada66fc4d4680861adb13c7fbf092 2023-02-09 16:54:12,314 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015112840a7e4ab144c4a25bb114519592c0408 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015112840a7e4ab144c4a25bb114519592c0408 2023-02-09 16:54:12,315 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511300740ec5c33054c5d9505df086d577121 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511300740ec5c33054c5d9505df086d577121 2023-02-09 16:54:12,315 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-02-09 16:54:12,315 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-02-09 16:54:12,316 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-09 16:54:12,316 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-09 16:54:12,316 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-09 16:54:12,316 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-09 16:54:12,316 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 16:54:12,317 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=22, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-09 16:54:12,319 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=22, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 1.6500 sec 2023-02-09 16:54:12,340 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] throttle.PressureAwareThroughputController(145): 191a93f3202aa607fa4f5a0c922be433#family1#compaction#23 average throughput is 9.73 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 16:54:12,397 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/.tmp/family1/763b5c7cf9fc4c7cb165dac584cffd45 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/763b5c7cf9fc4c7cb165dac584cffd45 2023-02-09 16:54:12,406 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 191a93f3202aa607fa4f5a0c922be433/family1 of 191a93f3202aa607fa4f5a0c922be433 into 763b5c7cf9fc4c7cb165dac584cffd45(size=167.4 K), total size for store is 167.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-09 16:54:12,406 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 191a93f3202aa607fa4f5a0c922be433: 2023-02-09 16:54:12,406 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1675961640805.191a93f3202aa607fa4f5a0c922be433., storeName=family1, fileCount=4, fileSize=344.3 K (166.0 K, 6.6 K, 5.5 K, 166.2 K), priority=2, time=1675961652306; duration=0sec 2023-02-09 16:54:12,406 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 16:54:12,451 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/6cce2f7dc2f64372921d0b3626b05b08, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/def229cbad684671ad617e8d8f9f8965, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/4bdec3b054cb4e279ce0c81b9ff7cfdf_SeqId_46_, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/8f7c171326b94e83ad39918862441926_SeqId_49_] to archive 2023-02-09 16:54:12,452 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 16:54:12,455 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/6cce2f7dc2f64372921d0b3626b05b08 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/6cce2f7dc2f64372921d0b3626b05b08 2023-02-09 16:54:12,457 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/def229cbad684671ad617e8d8f9f8965 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/def229cbad684671ad617e8d8f9f8965 2023-02-09 16:54:12,459 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/4bdec3b054cb4e279ce0c81b9ff7cfdf_SeqId_46_ to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/4bdec3b054cb4e279ce0c81b9ff7cfdf_SeqId_46_ 2023-02-09 16:54:12,460 INFO [Listener at localhost/41619] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=256 (was 247) Potentially hanging thread: hconnection-0x3b968e93-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-806311842_15 at /127.0.0.1:40672 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-806311842_15 at /127.0.0.1:40610 [Waiting for operation #18] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3b968e93-shared-pool-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-806311842_15 at /127.0.0.1:40502 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3b968e93-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-806311842_15 at /127.0.0.1:40456 [Waiting for operation #17] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x263a2993-shared-pool-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-806311842_15 at /127.0.0.1:40356 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-806311842_15 at /127.0.0.1:40574 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-806311842_15 at /127.0.0.1:40532 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-806311842_15 at /127.0.0.1:40588 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3b968e93-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:53887@0x49106e21-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: hconnection-0x3b968e93-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-806311842_15 at /127.0.0.1:40450 [Waiting for operation #18] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:53887@0x49106e21-SendThread(127.0.0.1:53887) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:53887@0x49106e21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/1671812890.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-806311842_15 at /127.0.0.1:40680 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-806311842_15 at /127.0.0.1:40488 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-806311842_15 at /127.0.0.1:40426 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3b968e93-shared-pool-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1218191331_15 at /127.0.0.1:40496 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-806311842_15 at /127.0.0.1:40446 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1218191331_15 at /127.0.0.1:40556 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-806311842_15 at /127.0.0.1:40570 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-806311842_15 at /127.0.0.1:40392 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3b968e93-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=613 (was 589) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=243 (was 243), ProcessCount=168 (was 168), AvailableMemoryMB=3499 (was 3929) 2023-02-09 16:54:12,464 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/8f7c171326b94e83ad39918862441926_SeqId_49_ to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/family1/8f7c171326b94e83ad39918862441926_SeqId_49_ 2023-02-09 16:54:12,478 INFO [Listener at localhost/41619] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=256, OpenFileDescriptor=613, MaxFileDescriptor=60000, SystemLoadAverage=243, ProcessCount=168, AvailableMemoryMB=3499 2023-02-09 16:54:12,479 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:12,479 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:12,484 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-09 16:54:12,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure2.ProcedureExecutor(1029): Stored pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:12,487 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 16:54:12,487 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithWeeklyPolicy" procId is: 23 2023-02-09 16:54:12,488 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:12,488 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 16:54:12,488 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:12,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-09 16:54:12,490 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25 2023-02-09 16:54:12,491 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25 empty. 2023-02-09 16:54:12,492 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25 2023-02-09 16:54:12,492 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithWeeklyPolicy regions 2023-02-09 16:54:12,590 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:12,590 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:12,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-09 16:54:12,791 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:12,791 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:12,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-09 16:54:12,908 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-02-09 16:54:12,909 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7671): creating {ENCODED => de35d6fbb4adad984ad971174d9fcf25, NAME => 'testMinorCompactionWithWeeklyPolicy,,1675961652483.de35d6fbb4adad984ad971174d9fcf25.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp 2023-02-09 16:54:13,093 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:13,093 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:13,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-09 16:54:13,316 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(865): Instantiated testMinorCompactionWithWeeklyPolicy,,1675961652483.de35d6fbb4adad984ad971174d9fcf25.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 16:54:13,317 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1603): Closing de35d6fbb4adad984ad971174d9fcf25, disabling compactions & flushes 2023-02-09 16:54:13,317 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1625): Closing region testMinorCompactionWithWeeklyPolicy,,1675961652483.de35d6fbb4adad984ad971174d9fcf25. 2023-02-09 16:54:13,317 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1675961652483.de35d6fbb4adad984ad971174d9fcf25. 2023-02-09 16:54:13,317 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1713): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1675961652483.de35d6fbb4adad984ad971174d9fcf25. after waiting 0 ms 2023-02-09 16:54:13,317 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1723): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1675961652483.de35d6fbb4adad984ad971174d9fcf25. 2023-02-09 16:54:13,317 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1837): Closed testMinorCompactionWithWeeklyPolicy,,1675961652483.de35d6fbb4adad984ad971174d9fcf25. 2023-02-09 16:54:13,317 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1557): Region close journal for de35d6fbb4adad984ad971174d9fcf25: Waiting for close lock at 1675961653317Disabling compacts and flushes for region at 1675961653317Disabling writes for close at 1675961653317Writing region close event to WAL at 1675961653317Closed at 1675961653317 2023-02-09 16:54:13,319 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 16:54:13,321 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithWeeklyPolicy,,1675961652483.de35d6fbb4adad984ad971174d9fcf25.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1675961653320"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675961653320"}]},"ts":"1675961653320"} 2023-02-09 16:54:13,322 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-09 16:54:13,323 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 16:54:13,323 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675961653323"}]},"ts":"1675961653323"} 2023-02-09 16:54:13,325 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-02-09 16:54:13,331 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=de35d6fbb4adad984ad971174d9fcf25, ASSIGN}] 2023-02-09 16:54:13,333 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=de35d6fbb4adad984ad971174d9fcf25, ASSIGN 2023-02-09 16:54:13,333 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=de35d6fbb4adad984ad971174d9fcf25, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35511,1675961620699; forceNewPlan=false, retain=false 2023-02-09 16:54:13,485 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=de35d6fbb4adad984ad971174d9fcf25, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:13,485 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithWeeklyPolicy,,1675961652483.de35d6fbb4adad984ad971174d9fcf25.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1675961653484"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675961653484"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675961653484"}]},"ts":"1675961653484"} 2023-02-09 16:54:13,487 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=24, state=RUNNABLE; OpenRegionProcedure de35d6fbb4adad984ad971174d9fcf25, server=jenkins-hbase4.apache.org,35511,1675961620699}] 2023-02-09 16:54:13,594 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:13,594 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:13,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-09 16:54:13,642 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMinorCompactionWithWeeklyPolicy,,1675961652483.de35d6fbb4adad984ad971174d9fcf25. 2023-02-09 16:54:13,643 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => de35d6fbb4adad984ad971174d9fcf25, NAME => 'testMinorCompactionWithWeeklyPolicy,,1675961652483.de35d6fbb4adad984ad971174d9fcf25.', STARTKEY => '', ENDKEY => ''} 2023-02-09 16:54:13,643 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithWeeklyPolicy de35d6fbb4adad984ad971174d9fcf25 2023-02-09 16:54:13,643 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMinorCompactionWithWeeklyPolicy,,1675961652483.de35d6fbb4adad984ad971174d9fcf25.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 16:54:13,643 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for de35d6fbb4adad984ad971174d9fcf25 2023-02-09 16:54:13,643 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for de35d6fbb4adad984ad971174d9fcf25 2023-02-09 16:54:13,644 INFO [StoreOpener-de35d6fbb4adad984ad971174d9fcf25-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region de35d6fbb4adad984ad971174d9fcf25 2023-02-09 16:54:13,646 DEBUG [StoreOpener-de35d6fbb4adad984ad971174d9fcf25-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1 2023-02-09 16:54:13,646 DEBUG [StoreOpener-de35d6fbb4adad984ad971174d9fcf25-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1 2023-02-09 16:54:13,646 INFO [StoreOpener-de35d6fbb4adad984ad971174d9fcf25-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region de35d6fbb4adad984ad971174d9fcf25 columnFamilyName family1 2023-02-09 16:54:13,648 INFO [StoreOpener-de35d6fbb4adad984ad971174d9fcf25-1] regionserver.HStore(310): Store=de35d6fbb4adad984ad971174d9fcf25/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 16:54:13,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25 2023-02-09 16:54:13,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25 2023-02-09 16:54:13,652 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for de35d6fbb4adad984ad971174d9fcf25 2023-02-09 16:54:13,654 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 16:54:13,654 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened de35d6fbb4adad984ad971174d9fcf25; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68173248, jitterRate=0.015860557556152344}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 16:54:13,655 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for de35d6fbb4adad984ad971174d9fcf25: Running coprocessor pre-open hook at 1675961653643Writing region info on filesystem at 1675961653643Initializing all the Stores at 1675961653644 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1675961653644Cleaning up temporary data from old regions at 1675961653650 (+6 ms)Cleaning up detritus from prior splits at 1675961653650Running coprocessor post-open hooks at 1675961653655 (+5 ms)Region opened successfully at 1675961653655 2023-02-09 16:54:13,655 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMinorCompactionWithWeeklyPolicy,,1675961652483.de35d6fbb4adad984ad971174d9fcf25., pid=25, masterSystemTime=1675961653639 2023-02-09 16:54:13,657 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMinorCompactionWithWeeklyPolicy,,1675961652483.de35d6fbb4adad984ad971174d9fcf25. 2023-02-09 16:54:13,657 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMinorCompactionWithWeeklyPolicy,,1675961652483.de35d6fbb4adad984ad971174d9fcf25. 2023-02-09 16:54:13,658 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=de35d6fbb4adad984ad971174d9fcf25, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:13,658 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithWeeklyPolicy,,1675961652483.de35d6fbb4adad984ad971174d9fcf25.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1675961653658"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675961653658"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675961653658"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675961653658"}]},"ts":"1675961653658"} 2023-02-09 16:54:13,662 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=24 2023-02-09 16:54:13,662 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=24, state=SUCCESS; OpenRegionProcedure de35d6fbb4adad984ad971174d9fcf25, server=jenkins-hbase4.apache.org,35511,1675961620699 in 173 msec 2023-02-09 16:54:13,664 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=23 2023-02-09 16:54:13,664 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=23, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=de35d6fbb4adad984ad971174d9fcf25, ASSIGN in 331 msec 2023-02-09 16:54:13,665 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 16:54:13,665 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675961653665"}]},"ts":"1675961653665"} 2023-02-09 16:54:13,666 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-02-09 16:54:13,668 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 16:54:13,670 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=23, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy in 1.1840 sec 2023-02-09 16:54:14,595 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:14,596 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:14,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-09 16:54:14,597 INFO [Listener at localhost/41619] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithWeeklyPolicy, procId: 23 completed 2023-02-09 16:54:14,623 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:14,623 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:14,624 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:54:14,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:14,626 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-09 16:54:14,626 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:14,626 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-09 16:54:14,626 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-09 16:54:14,626 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:14,627 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:14,628 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:14,628 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:14,628 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:14,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:14,628 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:14,628 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:54:14,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:14,629 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:14,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:54:14,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:14,629 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:14,629 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:14,629 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-09 16:54:14,629 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:14,629 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-09 16:54:14,629 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 16:54:14,630 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:54:14,630 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1675961652483.de35d6fbb4adad984ad971174d9fcf25. 2023-02-09 16:54:14,630 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1675961652483.de35d6fbb4adad984ad971174d9fcf25. started... 2023-02-09 16:54:14,630 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing de35d6fbb4adad984ad971174d9fcf25 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-09 16:54:15,064 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511308235330903934c9ababc4eafea5dc4f8 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201511308235330903934c9ababc4eafea5dc4f8 2023-02-09 16:54:15,468 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/.tmp/family1/6c22f9d29d894da290984e6bf1ccc0c8 2023-02-09 16:54:15,475 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/.tmp/family1/6c22f9d29d894da290984e6bf1ccc0c8 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1/6c22f9d29d894da290984e6bf1ccc0c8 2023-02-09 16:54:15,479 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1/6c22f9d29d894da290984e6bf1ccc0c8, entries=1000, sequenceid=5, filesize=165.1 K 2023-02-09 16:54:15,480 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for de35d6fbb4adad984ad971174d9fcf25 in 850ms, sequenceid=5, compaction requested=false 2023-02-09 16:54:15,481 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithWeeklyPolicy' 2023-02-09 16:54:15,481 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for de35d6fbb4adad984ad971174d9fcf25: 2023-02-09 16:54:15,481 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1675961652483.de35d6fbb4adad984ad971174d9fcf25. 2023-02-09 16:54:15,481 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 16:54:15,481 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 16:54:15,481 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:15,481 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-09 16:54:15,481 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-09 16:54:15,483 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:15,483 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:15,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:15,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:15,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:15,483 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:15,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:15,483 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:54:15,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:15,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:15,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:15,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:15,484 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-09 16:54:15,484 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@13e803d2[Count = 0] remaining members to acquire global barrier 2023-02-09 16:54:15,484 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-09 16:54:15,485 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:15,486 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:15,486 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:15,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:15,486 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-09 16:54:15,486 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-09 16:54:15,486 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:15,486 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:54:15,486 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:54:15,493 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:15,493 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-09 16:54:15,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:15,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:15,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:15,493 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:15,493 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-09 16:54:15,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:15,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:15,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:15,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:15,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:15,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:15,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:15,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:54:15,495 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-09 16:54:15,496 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-09 16:54:15,496 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:54:15,496 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:54:15,496 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:15,496 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:54:15,497 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:15,497 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:15,497 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:15,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:15,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:15,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:15,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:15,497 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:15,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:15,498 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:15,498 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:15,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:15,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:15,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:15,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:15,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:15,499 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:15,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:15,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:15,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:15,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:15,501 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:15,501 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:15,501 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:15,501 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:15,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:15,501 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:15,502 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-09 16:54:15,502 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:54:15,502 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:15,502 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:15,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:15,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:15,502 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:15,502 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 16:54:15,502 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:54:15,502 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:15,502 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:15,502 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:15,602 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:54:15,603 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:15,603 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:15,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:54:15,608 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:15,608 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:15,609 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:54:15,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 16:54:15,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:15,611 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-09 16:54:15,611 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:15,611 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-09 16:54:15,611 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-09 16:54:15,611 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:15,611 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:15,613 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:15,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:15,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:15,613 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:15,614 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:15,614 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:54:15,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:15,614 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:15,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:54:15,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:15,614 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:15,615 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-09 16:54:15,615 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:15,615 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-09 16:54:15,615 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:15,615 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-09 16:54:15,615 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 16:54:15,615 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:54:15,615 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1675961652483.de35d6fbb4adad984ad971174d9fcf25. 2023-02-09 16:54:15,615 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1675961652483.de35d6fbb4adad984ad971174d9fcf25. started... 2023-02-09 16:54:15,615 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing de35d6fbb4adad984ad971174d9fcf25 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-09 16:54:16,031 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128fcbb676636d345e2872107905623272b to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151128fcbb676636d345e2872107905623272b 2023-02-09 16:54:16,436 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/.tmp/family1/514fd2ae1e6d44ebb9935091b08a668b 2023-02-09 16:54:16,442 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/.tmp/family1/514fd2ae1e6d44ebb9935091b08a668b as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1/514fd2ae1e6d44ebb9935091b08a668b 2023-02-09 16:54:16,446 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1/514fd2ae1e6d44ebb9935091b08a668b, entries=1, sequenceid=9, filesize=5.0 K 2023-02-09 16:54:16,447 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for de35d6fbb4adad984ad971174d9fcf25 in 832ms, sequenceid=9, compaction requested=false 2023-02-09 16:54:16,447 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for de35d6fbb4adad984ad971174d9fcf25: 2023-02-09 16:54:16,447 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1675961652483.de35d6fbb4adad984ad971174d9fcf25. 2023-02-09 16:54:16,447 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 16:54:16,447 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 16:54:16,448 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:16,448 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-09 16:54:16,448 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-09 16:54:16,449 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:16,449 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:16,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:16,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:16,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:16,450 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:16,450 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:54:16,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:16,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:16,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:16,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:16,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:16,451 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-09 16:54:16,451 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5aa1b8c4[Count = 0] remaining members to acquire global barrier 2023-02-09 16:54:16,451 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-09 16:54:16,451 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:16,453 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:16,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:16,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:16,453 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-09 16:54:16,453 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:16,454 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:54:16,453 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-09 16:54:16,454 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:54:16,455 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:16,455 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-09 16:54:16,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:16,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:16,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:16,455 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:16,456 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-09 16:54:16,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:16,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:16,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:16,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:16,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:16,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:16,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:16,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:54:16,458 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-09 16:54:16,458 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-09 16:54:16,458 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:54:16,458 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:54:16,458 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:16,458 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:54:16,459 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:16,459 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:16,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:16,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:16,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:16,459 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:16,459 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:16,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:16,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:16,460 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:16,460 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:16,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:16,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:16,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:16,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:16,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:16,461 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:16,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:16,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:16,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:16,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:16,463 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:16,463 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:16,463 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:16,463 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:16,463 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:16,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:16,463 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-09 16:54:16,463 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-09 16:54:16,464 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:54:16,463 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:16,464 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:16,464 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:16,464 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:16,464 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:16,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:16,464 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 16:54:16,464 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:54:16,464 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:16,464 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:16,564 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:54:16,564 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:16,564 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:16,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:54:16,569 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:16,570 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:16,570 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:54:16,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 16:54:16,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:16,572 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-09 16:54:16,572 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:16,572 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-09 16:54:16,572 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-09 16:54:16,573 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:16,573 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:16,574 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:16,574 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:16,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:16,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:16,575 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:16,575 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:54:16,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:16,575 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:16,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:54:16,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:16,575 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:16,576 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-09 16:54:16,576 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:16,576 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-09 16:54:16,576 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:16,576 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-09 16:54:16,576 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 16:54:16,576 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:54:16,576 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1675961652483.de35d6fbb4adad984ad971174d9fcf25. 2023-02-09 16:54:16,576 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1675961652483.de35d6fbb4adad984ad971174d9fcf25. started... 2023-02-09 16:54:16,576 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing de35d6fbb4adad984ad971174d9fcf25 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 16:54:16,997 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201a362612b80d247ed8cd35c5a2cbfd1c0 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151201a362612b80d247ed8cd35c5a2cbfd1c0 2023-02-09 16:54:17,406 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/.tmp/family1/96a750f664294afbb305ed40107c5cba 2023-02-09 16:54:17,411 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/.tmp/family1/96a750f664294afbb305ed40107c5cba as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1/96a750f664294afbb305ed40107c5cba 2023-02-09 16:54:17,415 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1/96a750f664294afbb305ed40107c5cba, entries=1, sequenceid=13, filesize=4.9 K 2023-02-09 16:54:17,416 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for de35d6fbb4adad984ad971174d9fcf25 in 840ms, sequenceid=13, compaction requested=true 2023-02-09 16:54:17,416 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for de35d6fbb4adad984ad971174d9fcf25: 2023-02-09 16:54:17,416 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1675961652483.de35d6fbb4adad984ad971174d9fcf25. 2023-02-09 16:54:17,416 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 16:54:17,416 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 16:54:17,416 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:17,416 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-09 16:54:17,417 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-09 16:54:17,418 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:17,418 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:17,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:17,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:17,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:17,419 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:17,419 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:54:17,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:17,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:17,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:17,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:17,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:17,420 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-09 16:54:17,420 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3b94d7bd[Count = 0] remaining members to acquire global barrier 2023-02-09 16:54:17,420 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-09 16:54:17,420 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:17,421 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:17,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:17,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:17,422 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-09 16:54:17,422 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-09 16:54:17,422 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:54:17,422 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:17,422 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:54:17,423 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:17,423 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-09 16:54:17,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:17,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:17,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:17,423 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:17,423 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-09 16:54:17,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:17,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:17,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:17,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:17,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:17,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:17,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:17,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:54:17,425 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-09 16:54:17,425 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-09 16:54:17,425 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:54:17,425 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:54:17,425 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:17,425 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:54:17,428 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:17,428 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:17,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:17,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:17,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:17,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:17,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:17,428 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:17,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:17,428 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:17,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:17,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:17,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:17,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:17,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:17,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:17,429 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:17,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:17,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:17,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:17,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:17,434 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:17,434 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:17,434 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:17,434 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:17,434 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:17,434 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:17,434 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:17,434 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-09 16:54:17,434 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:54:17,434 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:17,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:17,434 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:17,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:17,434 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:17,435 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 16:54:17,435 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:54:17,435 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:17,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:17,535 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:54:17,535 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:17,535 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:17,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:54:17,540 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:17,540 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:17,540 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:54:17,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 16:54:17,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:17,542 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-09 16:54:17,542 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:17,542 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-09 16:54:17,542 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-09 16:54:17,542 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:17,542 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:17,544 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:17,544 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:17,544 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:17,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:17,544 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:17,544 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:54:17,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:17,544 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:17,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:54:17,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:17,545 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:17,545 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-09 16:54:17,545 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:17,545 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-09 16:54:17,545 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:17,545 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-09 16:54:17,545 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 16:54:17,545 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:54:17,545 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1675961652483.de35d6fbb4adad984ad971174d9fcf25. 2023-02-09 16:54:17,545 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1675961652483.de35d6fbb4adad984ad971174d9fcf25. started... 2023-02-09 16:54:17,545 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing de35d6fbb4adad984ad971174d9fcf25 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 16:54:17,960 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205dc75410685d646b5ae67dcb799bb150f to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205dc75410685d646b5ae67dcb799bb150f 2023-02-09 16:54:17,965 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/.tmp/family1/ac8deefa837848d7b2779b51f07b25c5 2023-02-09 16:54:17,970 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/.tmp/family1/ac8deefa837848d7b2779b51f07b25c5 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1/ac8deefa837848d7b2779b51f07b25c5 2023-02-09 16:54:17,975 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1/ac8deefa837848d7b2779b51f07b25c5, entries=1, sequenceid=17, filesize=4.9 K 2023-02-09 16:54:17,976 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for de35d6fbb4adad984ad971174d9fcf25 in 431ms, sequenceid=17, compaction requested=true 2023-02-09 16:54:17,976 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for de35d6fbb4adad984ad971174d9fcf25: 2023-02-09 16:54:17,976 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1675961652483.de35d6fbb4adad984ad971174d9fcf25. 2023-02-09 16:54:17,977 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 16:54:17,977 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 16:54:17,977 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:17,977 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-09 16:54:17,977 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-09 16:54:17,979 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:17,979 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:17,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:17,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:17,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:17,980 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:17,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:17,980 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:54:17,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:17,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:17,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:17,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:17,981 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-09 16:54:17,981 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6124dc1f[Count = 0] remaining members to acquire global barrier 2023-02-09 16:54:17,981 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-09 16:54:17,981 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:17,983 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:17,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:17,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:17,983 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-09 16:54:17,983 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-09 16:54:17,983 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:54:17,983 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:17,983 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:54:17,984 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-09 16:54:17,984 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:17,984 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:17,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:17,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:17,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:17,984 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-09 16:54:17,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:17,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:17,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:17,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:17,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:17,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:17,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:17,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:54:17,986 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-09 16:54:17,986 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-09 16:54:17,986 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:54:17,986 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:54:17,986 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:17,986 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:54:17,988 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:17,988 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:17,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:17,988 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:17,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:17,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:17,988 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:17,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:17,988 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:17,988 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:17,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:17,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:17,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:17,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:17,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:17,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:17,989 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:17,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:17,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:17,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:17,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:17,993 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:17,993 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:17,993 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:17,993 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:17,993 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-09 16:54:17,993 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:54:17,993 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:17,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:17,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:17,993 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:17,993 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 16:54:17,993 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:17,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:17,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:17,993 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:54:17,993 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-09 16:54:17,993 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:17,994 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:17,994 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:18,094 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:54:18,094 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:18,094 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:18,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:54:18,098 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:18,098 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:18,099 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:54:18,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 16:54:18,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:18,101 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-09 16:54:18,101 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:18,101 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-09 16:54:18,101 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-09 16:54:18,101 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:18,101 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:18,103 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:18,103 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:18,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:18,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:18,103 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:18,103 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:54:18,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:18,104 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:18,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:54:18,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:18,104 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:18,104 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-09 16:54:18,104 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:18,105 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-09 16:54:18,105 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:18,105 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-09 16:54:18,105 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 16:54:18,105 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:54:18,105 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1675961652483.de35d6fbb4adad984ad971174d9fcf25. 2023-02-09 16:54:18,105 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1675961652483.de35d6fbb4adad984ad971174d9fcf25. started... 2023-02-09 16:54:18,105 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing de35d6fbb4adad984ad971174d9fcf25 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 16:54:18,122 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228c91442bc09c0476ca5049f20c4c609ea to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228c91442bc09c0476ca5049f20c4c609ea 2023-02-09 16:54:18,527 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/.tmp/family1/2d0ed0d0c1564e33b2239b2c61ebed88 2023-02-09 16:54:18,532 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/.tmp/family1/2d0ed0d0c1564e33b2239b2c61ebed88 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1/2d0ed0d0c1564e33b2239b2c61ebed88 2023-02-09 16:54:18,537 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1/2d0ed0d0c1564e33b2239b2c61ebed88, entries=1, sequenceid=21, filesize=4.9 K 2023-02-09 16:54:18,538 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for de35d6fbb4adad984ad971174d9fcf25 in 433ms, sequenceid=21, compaction requested=true 2023-02-09 16:54:18,538 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for de35d6fbb4adad984ad971174d9fcf25: 2023-02-09 16:54:18,538 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1675961652483.de35d6fbb4adad984ad971174d9fcf25. 2023-02-09 16:54:18,538 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 16:54:18,538 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 16:54:18,538 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:18,538 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-09 16:54:18,538 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-09 16:54:18,540 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:18,540 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:18,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:18,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:18,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:18,540 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:18,540 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:54:18,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:18,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:18,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:18,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:18,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:18,541 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-09 16:54:18,541 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3201b57a[Count = 0] remaining members to acquire global barrier 2023-02-09 16:54:18,541 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-09 16:54:18,542 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:18,543 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:18,543 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:18,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:18,543 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-09 16:54:18,543 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-09 16:54:18,543 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:54:18,543 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:18,543 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:54:18,545 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:18,545 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-09 16:54:18,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:18,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:18,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:18,545 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:18,545 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-09 16:54:18,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:18,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:18,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:18,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:18,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:18,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:18,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:18,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:54:18,548 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-09 16:54:18,548 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-09 16:54:18,548 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:54:18,548 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:54:18,548 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:18,548 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:54:18,549 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:18,549 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:18,549 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:18,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:18,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:18,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:18,549 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:18,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:18,550 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:18,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:18,550 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:18,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:18,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:18,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:18,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:18,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:18,551 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:18,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:18,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:18,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:18,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:18,553 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:18,553 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:18,553 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:18,553 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-09 16:54:18,553 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:54:18,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:18,553 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-09 16:54:18,553 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:18,553 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:18,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:18,554 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:18,554 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 16:54:18,554 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:54:18,554 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:18,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:18,554 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:18,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:18,554 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:18,554 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:18,654 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:54:18,654 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:18,654 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:18,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:54:18,659 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:18,660 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:18,660 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:54:18,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 16:54:18,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:18,662 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-09 16:54:18,662 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:18,662 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-09 16:54:18,662 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-09 16:54:18,663 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:18,663 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:18,664 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:18,664 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:18,664 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:18,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:18,664 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:18,665 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:54:18,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:18,665 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:18,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:54:18,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:18,666 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:18,666 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-09 16:54:18,666 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:18,666 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-09 16:54:18,666 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:18,666 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-09 16:54:18,667 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 16:54:18,667 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:54:18,667 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1675961652483.de35d6fbb4adad984ad971174d9fcf25. 2023-02-09 16:54:18,667 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1675961652483.de35d6fbb4adad984ad971174d9fcf25. started... 2023-02-09 16:54:18,667 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing de35d6fbb4adad984ad971174d9fcf25 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 16:54:19,081 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231c7b1c274dbd54363bcb2b839e253f626 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231c7b1c274dbd54363bcb2b839e253f626 2023-02-09 16:54:19,171 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-09 16:54:19,487 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/.tmp/family1/4584be69b3ae45f382ddffb9a2937148 2023-02-09 16:54:19,493 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/.tmp/family1/4584be69b3ae45f382ddffb9a2937148 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1/4584be69b3ae45f382ddffb9a2937148 2023-02-09 16:54:19,502 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1/4584be69b3ae45f382ddffb9a2937148, entries=1, sequenceid=25, filesize=4.9 K 2023-02-09 16:54:19,503 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for de35d6fbb4adad984ad971174d9fcf25 in 836ms, sequenceid=25, compaction requested=true 2023-02-09 16:54:19,503 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for de35d6fbb4adad984ad971174d9fcf25: 2023-02-09 16:54:19,503 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1675961652483.de35d6fbb4adad984ad971174d9fcf25. 2023-02-09 16:54:19,503 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 16:54:19,503 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 16:54:19,503 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:19,503 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-09 16:54:19,504 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-09 16:54:19,507 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:19,507 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:19,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:19,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:19,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:19,507 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:19,507 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:54:19,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:19,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:19,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:19,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:19,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:19,511 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-09 16:54:19,511 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@65b15c66[Count = 0] remaining members to acquire global barrier 2023-02-09 16:54:19,511 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-09 16:54:19,512 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:19,514 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:19,514 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:54:19,516 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:19,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:19,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:19,516 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-09 16:54:19,516 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-09 16:54:19,516 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:54:19,518 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-09 16:54:19,518 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:19,518 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:19,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:19,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:19,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:19,518 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-09 16:54:19,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:19,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:19,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:19,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:19,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:19,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:19,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:19,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:54:19,523 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-09 16:54:19,523 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-09 16:54:19,523 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:54:19,523 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:54:19,523 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:19,523 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:54:19,529 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:19,529 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:19,529 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:19,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:19,529 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:19,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:19,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:19,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:19,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:19,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:19,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:19,530 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:19,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:19,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:19,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:19,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:19,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:19,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:19,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:19,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:19,535 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:19,538 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:19,538 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:19,538 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:19,538 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:19,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:19,538 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:19,540 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:19,540 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:19,540 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:19,540 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:19,540 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-09 16:54:19,540 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:54:19,540 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:19,540 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:19,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:19,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:19,541 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 16:54:19,541 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:54:19,641 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:54:19,641 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:19,641 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:19,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:54:19,646 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:19,647 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:19,647 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:54:19,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 16:54:19,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:19,649 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-09 16:54:19,649 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:19,649 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-09 16:54:19,649 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-09 16:54:19,650 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:19,650 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:19,651 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:19,651 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:19,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:19,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:19,651 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:19,652 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:54:19,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:19,652 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:19,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:54:19,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:19,653 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:19,660 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-09 16:54:19,660 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:19,660 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-09 16:54:19,660 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:19,660 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-09 16:54:19,660 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 16:54:19,660 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:54:19,660 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1675961652483.de35d6fbb4adad984ad971174d9fcf25. 2023-02-09 16:54:19,660 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1675961652483.de35d6fbb4adad984ad971174d9fcf25. started... 2023-02-09 16:54:19,661 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing de35d6fbb4adad984ad971174d9fcf25 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 16:54:20,075 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601013bc85946360c46c986e07c5493781134 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601013bc85946360c46c986e07c5493781134 2023-02-09 16:54:20,481 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/.tmp/family1/f1784dcee21f44249bd1238cf2789607 2023-02-09 16:54:20,491 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/.tmp/family1/f1784dcee21f44249bd1238cf2789607 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1/f1784dcee21f44249bd1238cf2789607 2023-02-09 16:54:20,497 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1/f1784dcee21f44249bd1238cf2789607, entries=1, sequenceid=29, filesize=4.9 K 2023-02-09 16:54:20,497 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for de35d6fbb4adad984ad971174d9fcf25 in 836ms, sequenceid=29, compaction requested=true 2023-02-09 16:54:20,498 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for de35d6fbb4adad984ad971174d9fcf25: 2023-02-09 16:54:20,498 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1675961652483.de35d6fbb4adad984ad971174d9fcf25. 2023-02-09 16:54:20,498 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 16:54:20,498 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 16:54:20,498 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:20,498 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-09 16:54:20,498 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-09 16:54:20,499 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:20,499 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:20,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:20,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:20,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:20,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:20,500 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:20,500 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:54:20,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:20,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:20,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:20,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:20,501 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-09 16:54:20,501 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@78854652[Count = 0] remaining members to acquire global barrier 2023-02-09 16:54:20,501 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-09 16:54:20,501 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:20,502 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:20,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:20,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:20,502 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-09 16:54:20,502 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-09 16:54:20,502 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:54:20,502 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:20,502 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:54:20,504 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-09 16:54:20,504 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:20,504 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:20,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:20,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:20,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:20,504 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-09 16:54:20,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:20,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:20,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:20,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:20,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:20,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:20,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:20,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:54:20,506 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-09 16:54:20,506 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-09 16:54:20,506 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:54:20,506 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:54:20,506 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:20,506 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:54:20,509 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:20,509 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:20,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:20,509 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:20,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:20,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:20,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:20,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:20,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:20,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:20,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:20,509 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:20,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:20,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:20,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:20,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:20,510 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:20,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:20,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:20,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:20,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:20,513 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:20,513 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:20,513 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:20,513 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:20,513 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:20,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:20,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:20,513 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-09 16:54:20,514 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:54:20,513 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:20,513 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:20,514 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:20,514 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:20,514 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:20,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:20,514 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 16:54:20,514 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:20,514 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:54:20,614 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:54:20,615 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:20,615 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:20,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:54:20,619 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:20,619 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:20,619 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:54:20,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 16:54:20,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:20,621 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-09 16:54:20,621 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:20,621 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-09 16:54:20,621 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-09 16:54:20,622 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:20,622 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:20,623 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:20,623 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:20,623 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:20,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:20,623 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:20,623 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:54:20,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:20,624 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:20,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:54:20,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:20,624 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:20,624 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-09 16:54:20,624 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:20,624 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-09 16:54:20,624 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:20,625 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-09 16:54:20,625 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 16:54:20,625 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:54:20,625 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1675961652483.de35d6fbb4adad984ad971174d9fcf25. 2023-02-09 16:54:20,625 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1675961652483.de35d6fbb4adad984ad971174d9fcf25. started... 2023-02-09 16:54:20,625 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing de35d6fbb4adad984ad971174d9fcf25 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 16:54:21,043 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103de0e4449f8b145a79c65f9503d09e4c9 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103de0e4449f8b145a79c65f9503d09e4c9 2023-02-09 16:54:21,455 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/.tmp/family1/3bea57023f024b39aceec6ec17dccfb1 2023-02-09 16:54:21,461 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/.tmp/family1/3bea57023f024b39aceec6ec17dccfb1 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1/3bea57023f024b39aceec6ec17dccfb1 2023-02-09 16:54:21,466 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1/3bea57023f024b39aceec6ec17dccfb1, entries=1, sequenceid=33, filesize=4.9 K 2023-02-09 16:54:21,467 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for de35d6fbb4adad984ad971174d9fcf25 in 842ms, sequenceid=33, compaction requested=true 2023-02-09 16:54:21,467 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for de35d6fbb4adad984ad971174d9fcf25: 2023-02-09 16:54:21,467 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1675961652483.de35d6fbb4adad984ad971174d9fcf25. 2023-02-09 16:54:21,467 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 16:54:21,467 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 16:54:21,467 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:21,467 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-09 16:54:21,467 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-09 16:54:21,469 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:21,469 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:21,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:21,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:21,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:21,470 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:21,470 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:54:21,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:21,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:21,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:21,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:21,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:21,471 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-09 16:54:21,471 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-09 16:54:21,471 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3f06a979[Count = 0] remaining members to acquire global barrier 2023-02-09 16:54:21,471 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:21,472 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:21,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:21,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:21,473 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-09 16:54:21,473 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-09 16:54:21,473 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:54:21,473 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:21,473 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:54:21,474 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:21,474 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-09 16:54:21,474 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:21,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:21,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:21,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:21,474 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-09 16:54:21,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:21,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:21,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:21,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:21,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:21,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:21,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:21,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:54:21,477 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-09 16:54:21,477 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-09 16:54:21,477 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:54:21,477 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:54:21,477 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:21,477 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:54:21,478 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:21,478 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:21,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:21,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:21,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:21,478 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:21,478 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:21,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:21,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:21,479 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:21,479 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:21,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:21,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:21,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:21,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:21,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:21,480 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:21,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:21,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:21,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:21,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:21,483 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:21,483 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:21,483 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:21,483 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:21,483 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-09 16:54:21,484 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:54:21,483 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:21,483 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:21,483 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:21,484 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:21,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:21,484 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:21,484 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 16:54:21,484 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:54:21,484 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:21,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:21,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:21,484 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:21,584 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:54:21,584 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:21,584 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:21,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:54:21,589 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:21,589 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:21,590 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:54:21,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 16:54:21,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:21,592 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-09 16:54:21,592 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:21,592 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-09 16:54:21,592 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-09 16:54:21,593 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:21,593 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:21,594 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:21,594 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:21,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:21,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:21,595 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:21,595 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:54:21,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:21,595 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:21,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:54:21,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:21,596 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:21,596 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-09 16:54:21,596 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:21,596 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-09 16:54:21,596 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:21,596 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-09 16:54:21,596 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 16:54:21,597 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:54:21,597 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1675961652483.de35d6fbb4adad984ad971174d9fcf25. 2023-02-09 16:54:21,597 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1675961652483.de35d6fbb4adad984ad971174d9fcf25. started... 2023-02-09 16:54:21,597 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing de35d6fbb4adad984ad971174d9fcf25 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 16:54:22,012 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509072aba78d4aa5c4832b1e49852ec431293 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201509072aba78d4aa5c4832b1e49852ec431293 2023-02-09 16:54:22,418 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/.tmp/family1/229c141f93604e1395543efec2d1930e 2023-02-09 16:54:22,424 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/.tmp/family1/229c141f93604e1395543efec2d1930e as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1/229c141f93604e1395543efec2d1930e 2023-02-09 16:54:22,430 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1/229c141f93604e1395543efec2d1930e, entries=1, sequenceid=37, filesize=4.9 K 2023-02-09 16:54:22,431 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for de35d6fbb4adad984ad971174d9fcf25 in 834ms, sequenceid=37, compaction requested=true 2023-02-09 16:54:22,432 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for de35d6fbb4adad984ad971174d9fcf25: 2023-02-09 16:54:22,432 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1675961652483.de35d6fbb4adad984ad971174d9fcf25. 2023-02-09 16:54:22,432 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 16:54:22,432 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 16:54:22,432 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:22,432 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-09 16:54:22,432 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-09 16:54:22,434 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:22,434 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:22,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:22,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:22,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:22,434 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:22,434 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:54:22,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:22,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:22,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:22,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:22,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:22,436 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-09 16:54:22,436 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@136186[Count = 0] remaining members to acquire global barrier 2023-02-09 16:54:22,436 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-09 16:54:22,436 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:22,441 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:22,441 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:22,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:22,441 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-09 16:54:22,441 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-09 16:54:22,441 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:22,441 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:54:22,441 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:54:22,443 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:22,443 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-09 16:54:22,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:22,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:22,443 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:22,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:22,443 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-09 16:54:22,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:22,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:22,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:22,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:22,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:22,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:22,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:22,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:54:22,446 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-09 16:54:22,446 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-09 16:54:22,446 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:54:22,446 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:54:22,446 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:22,446 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:54:22,447 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:22,447 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:22,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:22,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:22,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:22,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:22,447 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:22,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:22,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:22,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:22,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:22,448 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:22,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:22,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:22,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:22,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:22,450 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:22,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:22,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:22,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:22,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:22,452 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:22,453 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:22,453 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:22,453 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:22,453 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:22,453 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:22,453 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-09 16:54:22,453 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:22,453 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:22,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:22,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:22,453 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:22,453 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:54:22,453 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-09 16:54:22,453 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:22,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:22,453 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 16:54:22,454 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:54:22,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:22,554 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:54:22,554 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:22,554 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:22,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:54:22,559 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:22,559 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:22,559 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:54:22,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 16:54:22,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:22,561 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-09 16:54:22,561 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:22,561 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-09 16:54:22,561 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-09 16:54:22,562 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:22,562 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:22,567 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:22,567 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:22,567 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:22,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:22,567 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:22,567 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:54:22,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:22,568 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:22,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:54:22,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:22,569 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:22,569 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-09 16:54:22,569 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:22,569 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-09 16:54:22,569 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:22,569 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-09 16:54:22,569 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 16:54:22,569 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:54:22,569 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1675961652483.de35d6fbb4adad984ad971174d9fcf25. 2023-02-09 16:54:22,569 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1675961652483.de35d6fbb4adad984ad971174d9fcf25. started... 2023-02-09 16:54:22,570 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing de35d6fbb4adad984ad971174d9fcf25 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 16:54:22,986 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112038dbc7712414492bb27c266dbbf459bf to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015112038dbc7712414492bb27c266dbbf459bf 2023-02-09 16:54:23,392 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/.tmp/family1/1455b791ad634646a8f3ba8c9305de0a 2023-02-09 16:54:23,397 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/.tmp/family1/1455b791ad634646a8f3ba8c9305de0a as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1/1455b791ad634646a8f3ba8c9305de0a 2023-02-09 16:54:23,402 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1/1455b791ad634646a8f3ba8c9305de0a, entries=1, sequenceid=41, filesize=4.9 K 2023-02-09 16:54:23,403 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for de35d6fbb4adad984ad971174d9fcf25 in 832ms, sequenceid=41, compaction requested=true 2023-02-09 16:54:23,403 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for de35d6fbb4adad984ad971174d9fcf25: 2023-02-09 16:54:23,403 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1675961652483.de35d6fbb4adad984ad971174d9fcf25. 2023-02-09 16:54:23,403 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 16:54:23,403 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 16:54:23,403 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:23,403 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-09 16:54:23,403 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-09 16:54:23,404 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:23,404 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:23,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:23,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:23,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:23,405 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:23,405 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:54:23,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:23,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:23,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:23,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:23,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:23,406 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-09 16:54:23,406 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6fae4f8e[Count = 0] remaining members to acquire global barrier 2023-02-09 16:54:23,406 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-09 16:54:23,406 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:23,407 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:23,407 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:23,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:23,407 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-09 16:54:23,407 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-09 16:54:23,407 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:23,408 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:54:23,407 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:54:23,409 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:23,409 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-09 16:54:23,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:23,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:23,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:23,409 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:23,409 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-09 16:54:23,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:23,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:23,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:23,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:23,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:23,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:23,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:23,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:54:23,411 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-09 16:54:23,411 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-09 16:54:23,411 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:54:23,411 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:54:23,411 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:23,412 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:54:23,414 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:23,414 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:23,414 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:23,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:23,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:23,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:23,414 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:23,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:23,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:23,414 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:23,414 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:23,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:23,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:23,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:23,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:23,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:23,415 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:23,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:23,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:23,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:23,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:23,417 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:23,418 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:23,418 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:23,418 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-09 16:54:23,418 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:54:23,418 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:23,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:23,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:23,418 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:23,418 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:23,418 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:23,418 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 16:54:23,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:23,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:23,418 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:54:23,418 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:23,418 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:23,418 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:23,518 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:54:23,519 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:23,519 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:23,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:54:23,521 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41333] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMinorCompactionWithWeeklyPolicy 2023-02-09 16:54:23,522 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-09 16:54:23,523 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-09 16:54:23,524 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 16:54:23,524 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=26, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675962263524 2023-02-09 16:54:23,527 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-09 16:54:23,529 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 0 del files, 9 selected files, and 0 irrelevant files table 'testMinorCompactionWithWeeklyPolicy' and column 'family1' 2023-02-09 16:54:23,529 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-09 16:54:23,529 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] zookeeper.ReadOnlyZKClient(139): Connect 0x547c00ac to 127.0.0.1:53887 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 16:54:23,535 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5b11fea6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 16:54:23,535 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-09 16:54:24,389 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103faac561b18634c3c9a3771541a34ee51 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103faac561b18634c3c9a3771541a34ee51 2023-02-09 16:54:24,390 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-09 16:54:24,404 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 16:54:24,405 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36392, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 16:54:24,411 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:24,411 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:24,412 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-09 16:54:24,414 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50326, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-09 16:54:24,426 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/19984f716ae54c10ae3a316d619d3269 first=Optional[r3] last=Optional[r6] 2023-02-09 16:54:24,427 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1675961652483.de35d6fbb4adad984ad971174d9fcf25., hostname=jenkins-hbase4.apache.org,35511,1675961620699, seqNum=2 for row with hfile group [{family1,hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/19984f716ae54c10ae3a316d619d3269}] 2023-02-09 16:54:24,432 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(763): Validating hfile at hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/19984f716ae54c10ae3a316d619d3269 for inclusion in de35d6fbb4adad984ad971174d9fcf25/family1 2023-02-09 16:54:24,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-02-09 16:54:24,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(777): Region bounds: first= last= 2023-02-09 16:54:24,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HRegion(2445): Flush status journal for de35d6fbb4adad984ad971174d9fcf25: 2023-02-09 16:54:24,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/19984f716ae54c10ae3a316d619d3269 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMinorCompactionWithWeeklyPolicy__rmvr3thbh20br4sl27r9bu64pqjnqn9jhfbk107gtf95088v62c453ocg284rvgl/family1/19984f716ae54c10ae3a316d619d3269 2023-02-09 16:54:24,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMinorCompactionWithWeeklyPolicy__rmvr3thbh20br4sl27r9bu64pqjnqn9jhfbk107gtf95088v62c453ocg284rvgl/family1/19984f716ae54c10ae3a316d619d3269 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1/0e28eb7c63634cd7af82bb5426790270_SeqId_44_ 2023-02-09 16:54:24,439 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(849): Loaded HFile hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMinorCompactionWithWeeklyPolicy__rmvr3thbh20br4sl27r9bu64pqjnqn9jhfbk107gtf95088v62c453ocg284rvgl/family1/19984f716ae54c10ae3a316d619d3269 into de35d6fbb4adad984ad971174d9fcf25/family1 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1/0e28eb7c63634cd7af82bb5426790270_SeqId_44_ - updating store file list. 2023-02-09 16:54:24,443 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(882): Loaded HFile hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1/0e28eb7c63634cd7af82bb5426790270_SeqId_44_ into de35d6fbb4adad984ad971174d9fcf25/family1 2023-02-09 16:54:24,443 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(855): Successfully loaded hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMinorCompactionWithWeeklyPolicy__rmvr3thbh20br4sl27r9bu64pqjnqn9jhfbk107gtf95088v62c453ocg284rvgl/family1/19984f716ae54c10ae3a316d619d3269 into de35d6fbb4adad984ad971174d9fcf25/family1 (new location: hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1/0e28eb7c63634cd7af82bb5426790270_SeqId_44_) 2023-02-09 16:54:24,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMinorCompactionWithWeeklyPolicy__rmvr3thbh20br4sl27r9bu64pqjnqn9jhfbk107gtf95088v62c453ocg284rvgl/family1/19984f716ae54c10ae3a316d619d3269 2023-02-09 16:54:24,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-09 16:54:24,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-09 16:54:24,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(1912): de35d6fbb4adad984ad971174d9fcf25/family1 is initiating minor compaction 2023-02-09 16:54:24,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@5d76ed20; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 16:54:24,447 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of de35d6fbb4adad984ad971174d9fcf25/family1 in testMinorCompactionWithWeeklyPolicy,,1675961652483.de35d6fbb4adad984ad971174d9fcf25. 2023-02-09 16:54:24,447 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1/514fd2ae1e6d44ebb9935091b08a668b, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1/96a750f664294afbb305ed40107c5cba, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1/ac8deefa837848d7b2779b51f07b25c5, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1/2d0ed0d0c1564e33b2239b2c61ebed88, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1/4584be69b3ae45f382ddffb9a2937148, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1/f1784dcee21f44249bd1238cf2789607, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1/3bea57023f024b39aceec6ec17dccfb1, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1/229c141f93604e1395543efec2d1930e, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1/1455b791ad634646a8f3ba8c9305de0a, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1/0e28eb7c63634cd7af82bb5426790270_SeqId_44_] into tmpdir=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/.tmp, totalSize=50.0 K 2023-02-09 16:54:24,447 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting 514fd2ae1e6d44ebb9935091b08a668b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-09 16:54:24,447 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting 96a750f664294afbb305ed40107c5cba, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-09 16:54:24,447 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting ac8deefa837848d7b2779b51f07b25c5, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-09 16:54:24,447 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting 2d0ed0d0c1564e33b2239b2c61ebed88, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-09 16:54:24,447 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting 4584be69b3ae45f382ddffb9a2937148, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-09 16:54:24,447 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting f1784dcee21f44249bd1238cf2789607, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-09 16:54:24,448 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting 3bea57023f024b39aceec6ec17dccfb1, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-09 16:54:24,448 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting 229c141f93604e1395543efec2d1930e, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-09 16:54:24,448 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting 1455b791ad634646a8f3ba8c9305de0a, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-09 16:54:24,448 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting 0e28eb7c63634cd7af82bb5426790270_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-09 16:54:24,449 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-09 16:54:24,450 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 16:54:24,452 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228c91442bc09c0476ca5049f20c4c609ea to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228c91442bc09c0476ca5049f20c4c609ea 2023-02-09 16:54:24,453 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231c7b1c274dbd54363bcb2b839e253f626 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231c7b1c274dbd54363bcb2b839e253f626 2023-02-09 16:54:24,454 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601013bc85946360c46c986e07c5493781134 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601013bc85946360c46c986e07c5493781134 2023-02-09 16:54:24,456 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103de0e4449f8b145a79c65f9503d09e4c9 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103de0e4449f8b145a79c65f9503d09e4c9 2023-02-09 16:54:24,456 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-02-09 16:54:24,456 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-02-09 16:54:24,457 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-09 16:54:24,457 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-09 16:54:24,457 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-09 16:54:24,457 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-09 16:54:24,457 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-09 16:54:24,457 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-09 16:54:24,457 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-09 16:54:24,457 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-09 16:54:24,487 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] throttle.PressureAwareThroughputController(145): de35d6fbb4adad984ad971174d9fcf25#family1#compaction#34 average throughput is 0.27 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 16:54:24,905 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/.tmp/family1/297e0fa753c54037b82955c0fac91203 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1/297e0fa753c54037b82955c0fac91203 2023-02-09 16:54:24,911 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in de35d6fbb4adad984ad971174d9fcf25/family1 of de35d6fbb4adad984ad971174d9fcf25 into 297e0fa753c54037b82955c0fac91203(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-09 16:54:24,911 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for de35d6fbb4adad984ad971174d9fcf25: 2023-02-09 16:54:24,912 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1675961652483.de35d6fbb4adad984ad971174d9fcf25., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1675961664447; duration=0sec 2023-02-09 16:54:24,912 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 16:54:24,964 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1/514fd2ae1e6d44ebb9935091b08a668b, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1/96a750f664294afbb305ed40107c5cba, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1/ac8deefa837848d7b2779b51f07b25c5, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1/2d0ed0d0c1564e33b2239b2c61ebed88, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1/4584be69b3ae45f382ddffb9a2937148, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1/f1784dcee21f44249bd1238cf2789607, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1/3bea57023f024b39aceec6ec17dccfb1, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1/229c141f93604e1395543efec2d1930e, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1/1455b791ad634646a8f3ba8c9305de0a, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1/0e28eb7c63634cd7af82bb5426790270_SeqId_44_] to archive 2023-02-09 16:54:24,965 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 16:54:24,967 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1/514fd2ae1e6d44ebb9935091b08a668b to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1/514fd2ae1e6d44ebb9935091b08a668b 2023-02-09 16:54:24,969 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1/96a750f664294afbb305ed40107c5cba to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1/96a750f664294afbb305ed40107c5cba 2023-02-09 16:54:24,971 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1/ac8deefa837848d7b2779b51f07b25c5 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1/ac8deefa837848d7b2779b51f07b25c5 2023-02-09 16:54:24,972 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1/2d0ed0d0c1564e33b2239b2c61ebed88 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1/2d0ed0d0c1564e33b2239b2c61ebed88 2023-02-09 16:54:24,974 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1/4584be69b3ae45f382ddffb9a2937148 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1/4584be69b3ae45f382ddffb9a2937148 2023-02-09 16:54:24,975 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1/f1784dcee21f44249bd1238cf2789607 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1/f1784dcee21f44249bd1238cf2789607 2023-02-09 16:54:24,977 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1/3bea57023f024b39aceec6ec17dccfb1 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1/3bea57023f024b39aceec6ec17dccfb1 2023-02-09 16:54:24,978 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1/229c141f93604e1395543efec2d1930e to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1/229c141f93604e1395543efec2d1930e 2023-02-09 16:54:24,979 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1/1455b791ad634646a8f3ba8c9305de0a to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1/1455b791ad634646a8f3ba8c9305de0a 2023-02-09 16:54:24,981 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1/0e28eb7c63634cd7af82bb5426790270_SeqId_44_ to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1/0e28eb7c63634cd7af82bb5426790270_SeqId_44_ 2023-02-09 16:54:25,300 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512052d3d7e4ba71e4059873580cb9dadc432 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512052d3d7e4ba71e4059873580cb9dadc432 2023-02-09 16:54:25,301 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-09 16:54:25,321 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:25,321 INFO [MobCompactor-pool-0] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:25,330 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f77dfe8fd4734328a357e089f86ea5a3 first=Optional[r1] last=Optional[r2] 2023-02-09 16:54:25,330 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1675961652483.de35d6fbb4adad984ad971174d9fcf25., hostname=jenkins-hbase4.apache.org,35511,1675961620699, seqNum=2 for row with hfile group [{family1,hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f77dfe8fd4734328a357e089f86ea5a3}] 2023-02-09 16:54:25,332 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(763): Validating hfile at hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f77dfe8fd4734328a357e089f86ea5a3 for inclusion in de35d6fbb4adad984ad971174d9fcf25/family1 2023-02-09 16:54:25,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-02-09 16:54:25,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(777): Region bounds: first= last= 2023-02-09 16:54:25,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HRegion(2445): Flush status journal for de35d6fbb4adad984ad971174d9fcf25: 2023-02-09 16:54:25,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f77dfe8fd4734328a357e089f86ea5a3 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMinorCompactionWithWeeklyPolicy__k7dk448m8urpn996hjfgv97f8p7bpeutsv6jogq4nkeas8df2rngbbg4phhl6qsv/family1/f77dfe8fd4734328a357e089f86ea5a3 2023-02-09 16:54:25,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMinorCompactionWithWeeklyPolicy__k7dk448m8urpn996hjfgv97f8p7bpeutsv6jogq4nkeas8df2rngbbg4phhl6qsv/family1/f77dfe8fd4734328a357e089f86ea5a3 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1/7ebd993d4dd048a7adf38cbded1d62fc_SeqId_47_ 2023-02-09 16:54:25,343 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(849): Loaded HFile hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMinorCompactionWithWeeklyPolicy__k7dk448m8urpn996hjfgv97f8p7bpeutsv6jogq4nkeas8df2rngbbg4phhl6qsv/family1/f77dfe8fd4734328a357e089f86ea5a3 into de35d6fbb4adad984ad971174d9fcf25/family1 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1/7ebd993d4dd048a7adf38cbded1d62fc_SeqId_47_ - updating store file list. 2023-02-09 16:54:25,347 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(882): Loaded HFile hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1/7ebd993d4dd048a7adf38cbded1d62fc_SeqId_47_ into de35d6fbb4adad984ad971174d9fcf25/family1 2023-02-09 16:54:25,348 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(855): Successfully loaded hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMinorCompactionWithWeeklyPolicy__k7dk448m8urpn996hjfgv97f8p7bpeutsv6jogq4nkeas8df2rngbbg4phhl6qsv/family1/f77dfe8fd4734328a357e089f86ea5a3 into de35d6fbb4adad984ad971174d9fcf25/family1 (new location: hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1/7ebd993d4dd048a7adf38cbded1d62fc_SeqId_47_) 2023-02-09 16:54:25,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMinorCompactionWithWeeklyPolicy__k7dk448m8urpn996hjfgv97f8p7bpeutsv6jogq4nkeas8df2rngbbg4phhl6qsv/family1/f77dfe8fd4734328a357e089f86ea5a3 2023-02-09 16:54:25,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-09 16:54:25,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 181014 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-09 16:54:25,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(1912): de35d6fbb4adad984ad971174d9fcf25/family1 is initiating minor compaction (all files) 2023-02-09 16:54:25,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@38165ec1; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 16:54:25,349 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of de35d6fbb4adad984ad971174d9fcf25/family1 in testMinorCompactionWithWeeklyPolicy,,1675961652483.de35d6fbb4adad984ad971174d9fcf25. 2023-02-09 16:54:25,349 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1/6c22f9d29d894da290984e6bf1ccc0c8, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1/297e0fa753c54037b82955c0fac91203, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1/7ebd993d4dd048a7adf38cbded1d62fc_SeqId_47_] into tmpdir=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/.tmp, totalSize=176.8 K 2023-02-09 16:54:25,350 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting 6c22f9d29d894da290984e6bf1ccc0c8, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878845085 2023-02-09 16:54:25,350 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting 297e0fa753c54037b82955c0fac91203, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621245085 2023-02-09 16:54:25,351 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting 7ebd993d4dd048a7adf38cbded1d62fc_SeqId_47_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965245085 2023-02-09 16:54:25,351 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-09 16:54:25,352 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 16:54:25,354 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151201a362612b80d247ed8cd35c5a2cbfd1c0 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151201a362612b80d247ed8cd35c5a2cbfd1c0 2023-02-09 16:54:25,356 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205dc75410685d646b5ae67dcb799bb150f to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205dc75410685d646b5ae67dcb799bb150f 2023-02-09 16:54:25,356 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 2 expired mob files are deleted 2023-02-09 16:54:25,356 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-02-09 16:54:25,356 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-09 16:54:25,356 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-09 16:54:25,356 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 16:54:25,358 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=26, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-09 16:54:25,359 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.8370 sec 2023-02-09 16:54:25,382 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-09 16:54:25,383 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x547c00ac to 127.0.0.1:53887 2023-02-09 16:54:25,383 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 16:54:25,384 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-09 16:54:25,384 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x49106e21 to 127.0.0.1:53887 2023-02-09 16:54:25,384 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 16:54:25,384 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-09 16:54:25,384 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x75610f9b to 127.0.0.1:53887 2023-02-09 16:54:25,384 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 16:54:25,385 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-09 16:54:25,385 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2ff994a1 to 127.0.0.1:53887 2023-02-09 16:54:25,385 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 16:54:25,387 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] throttle.PressureAwareThroughputController(145): de35d6fbb4adad984ad971174d9fcf25#family1#compaction#35 average throughput is 5.95 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 16:54:25,466 INFO [Listener at localhost/41619] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=255 (was 256), OpenFileDescriptor=600 (was 613), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=204 (was 243), ProcessCount=168 (was 168), AvailableMemoryMB=3200 (was 3499) 2023-02-09 16:54:25,477 INFO [Listener at localhost/41619] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=255, OpenFileDescriptor=600, MaxFileDescriptor=60000, SystemLoadAverage=204, ProcessCount=168, AvailableMemoryMB=3199 2023-02-09 16:54:25,477 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:25,477 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:25,479 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-02-09 16:54:25,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles 2023-02-09 16:54:25,482 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 16:54:25,482 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testScannerOnBulkLoadRefHFiles" procId is: 27 2023-02-09 16:54:25,482 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:25,482 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:25,483 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 16:54:25,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-09 16:54:25,485 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/default/testScannerOnBulkLoadRefHFiles/42b6e2ba1146417ba4c5be92498b1d58 2023-02-09 16:54:25,485 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/default/testScannerOnBulkLoadRefHFiles/8c4f1be909138cea70e12c87de376ed7 2023-02-09 16:54:25,485 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/default/testScannerOnBulkLoadRefHFiles/3732f079659451c27d92f87ad081fc3c 2023-02-09 16:54:25,485 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/default/testScannerOnBulkLoadRefHFiles/42b6e2ba1146417ba4c5be92498b1d58 empty. 2023-02-09 16:54:25,485 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/default/testScannerOnBulkLoadRefHFiles/8c4f1be909138cea70e12c87de376ed7 empty. 2023-02-09 16:54:25,485 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/default/testScannerOnBulkLoadRefHFiles/3732f079659451c27d92f87ad081fc3c empty. 2023-02-09 16:54:25,486 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/default/testScannerOnBulkLoadRefHFiles/42b6e2ba1146417ba4c5be92498b1d58 2023-02-09 16:54:25,486 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/default/testScannerOnBulkLoadRefHFiles/8c4f1be909138cea70e12c87de376ed7 2023-02-09 16:54:25,486 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/default/testScannerOnBulkLoadRefHFiles/3732f079659451c27d92f87ad081fc3c 2023-02-09 16:54:25,486 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testScannerOnBulkLoadRefHFiles regions 2023-02-09 16:54:25,583 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:25,584 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:25,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-09 16:54:25,785 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:25,785 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:25,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-09 16:54:25,895 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/default/testScannerOnBulkLoadRefHFiles/.tabledesc/.tableinfo.0000000001 2023-02-09 16:54:25,896 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(7671): creating {ENCODED => 3732f079659451c27d92f87ad081fc3c, NAME => 'testScannerOnBulkLoadRefHFiles,2,1675961665479.3732f079659451c27d92f87ad081fc3c.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp 2023-02-09 16:54:25,897 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(7671): creating {ENCODED => 42b6e2ba1146417ba4c5be92498b1d58, NAME => 'testScannerOnBulkLoadRefHFiles,,1675961665479.42b6e2ba1146417ba4c5be92498b1d58.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp 2023-02-09 16:54:25,897 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(7671): creating {ENCODED => 8c4f1be909138cea70e12c87de376ed7, NAME => 'testScannerOnBulkLoadRefHFiles,1,1675961665479.8c4f1be909138cea70e12c87de376ed7.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp 2023-02-09 16:54:25,907 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,2,1675961665479.3732f079659451c27d92f87ad081fc3c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 16:54:25,908 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1603): Closing 3732f079659451c27d92f87ad081fc3c, disabling compactions & flushes 2023-02-09 16:54:25,908 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,2,1675961665479.3732f079659451c27d92f87ad081fc3c. 2023-02-09 16:54:25,908 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1675961665479.3732f079659451c27d92f87ad081fc3c. 2023-02-09 16:54:25,908 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1675961665479.3732f079659451c27d92f87ad081fc3c. after waiting 0 ms 2023-02-09 16:54:25,908 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1675961665479.3732f079659451c27d92f87ad081fc3c. 2023-02-09 16:54:25,908 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,2,1675961665479.3732f079659451c27d92f87ad081fc3c. 2023-02-09 16:54:25,908 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1557): Region close journal for 3732f079659451c27d92f87ad081fc3c: Waiting for close lock at 1675961665908Disabling compacts and flushes for region at 1675961665908Disabling writes for close at 1675961665908Writing region close event to WAL at 1675961665908Closed at 1675961665908 2023-02-09 16:54:25,909 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,,1675961665479.42b6e2ba1146417ba4c5be92498b1d58.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 16:54:25,909 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1603): Closing 42b6e2ba1146417ba4c5be92498b1d58, disabling compactions & flushes 2023-02-09 16:54:25,910 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,,1675961665479.42b6e2ba1146417ba4c5be92498b1d58. 2023-02-09 16:54:25,910 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1675961665479.42b6e2ba1146417ba4c5be92498b1d58. 2023-02-09 16:54:25,910 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1675961665479.42b6e2ba1146417ba4c5be92498b1d58. after waiting 0 ms 2023-02-09 16:54:25,910 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1675961665479.42b6e2ba1146417ba4c5be92498b1d58. 2023-02-09 16:54:25,910 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,,1675961665479.42b6e2ba1146417ba4c5be92498b1d58. 2023-02-09 16:54:25,910 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1557): Region close journal for 42b6e2ba1146417ba4c5be92498b1d58: Waiting for close lock at 1675961665909Disabling compacts and flushes for region at 1675961665909Disabling writes for close at 1675961665910 (+1 ms)Writing region close event to WAL at 1675961665910Closed at 1675961665910 2023-02-09 16:54:26,086 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:26,086 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:26,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-09 16:54:26,309 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,1,1675961665479.8c4f1be909138cea70e12c87de376ed7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 16:54:26,309 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1603): Closing 8c4f1be909138cea70e12c87de376ed7, disabling compactions & flushes 2023-02-09 16:54:26,309 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,1,1675961665479.8c4f1be909138cea70e12c87de376ed7. 2023-02-09 16:54:26,309 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1675961665479.8c4f1be909138cea70e12c87de376ed7. 2023-02-09 16:54:26,309 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1675961665479.8c4f1be909138cea70e12c87de376ed7. after waiting 0 ms 2023-02-09 16:54:26,309 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1675961665479.8c4f1be909138cea70e12c87de376ed7. 2023-02-09 16:54:26,309 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,1,1675961665479.8c4f1be909138cea70e12c87de376ed7. 2023-02-09 16:54:26,309 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1557): Region close journal for 8c4f1be909138cea70e12c87de376ed7: Waiting for close lock at 1675961666309Disabling compacts and flushes for region at 1675961666309Disabling writes for close at 1675961666309Writing region close event to WAL at 1675961666309Closed at 1675961666309 2023-02-09 16:54:26,312 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 16:54:26,314 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,2,1675961665479.3732f079659451c27d92f87ad081fc3c.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1675961666313"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675961666313"}]},"ts":"1675961666313"} 2023-02-09 16:54:26,314 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,,1675961665479.42b6e2ba1146417ba4c5be92498b1d58.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1675961666313"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675961666313"}]},"ts":"1675961666313"} 2023-02-09 16:54:26,314 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,1,1675961665479.8c4f1be909138cea70e12c87de376ed7.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1675961666313"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675961666313"}]},"ts":"1675961666313"} 2023-02-09 16:54:26,317 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-02-09 16:54:26,318 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 16:54:26,319 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675961666319"}]},"ts":"1675961666319"} 2023-02-09 16:54:26,320 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLING in hbase:meta 2023-02-09 16:54:26,324 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=42b6e2ba1146417ba4c5be92498b1d58, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=8c4f1be909138cea70e12c87de376ed7, ASSIGN}, {pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=3732f079659451c27d92f87ad081fc3c, ASSIGN}] 2023-02-09 16:54:26,326 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=42b6e2ba1146417ba4c5be92498b1d58, ASSIGN 2023-02-09 16:54:26,326 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=8c4f1be909138cea70e12c87de376ed7, ASSIGN 2023-02-09 16:54:26,326 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=3732f079659451c27d92f87ad081fc3c, ASSIGN 2023-02-09 16:54:26,329 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=3732f079659451c27d92f87ad081fc3c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35511,1675961620699; forceNewPlan=false, retain=false 2023-02-09 16:54:26,329 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=42b6e2ba1146417ba4c5be92498b1d58, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35511,1675961620699; forceNewPlan=false, retain=false 2023-02-09 16:54:26,329 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=8c4f1be909138cea70e12c87de376ed7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35511,1675961620699; forceNewPlan=false, retain=false 2023-02-09 16:54:26,481 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=42b6e2ba1146417ba4c5be92498b1d58, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:26,481 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=8c4f1be909138cea70e12c87de376ed7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:26,481 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=3732f079659451c27d92f87ad081fc3c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:26,481 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,,1675961665479.42b6e2ba1146417ba4c5be92498b1d58.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1675961666481"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675961666481"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675961666481"}]},"ts":"1675961666481"} 2023-02-09 16:54:26,481 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,1,1675961665479.8c4f1be909138cea70e12c87de376ed7.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1675961666481"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675961666481"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675961666481"}]},"ts":"1675961666481"} 2023-02-09 16:54:26,481 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,2,1675961665479.3732f079659451c27d92f87ad081fc3c.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1675961666481"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675961666481"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675961666481"}]},"ts":"1675961666481"} 2023-02-09 16:54:26,483 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure 42b6e2ba1146417ba4c5be92498b1d58, server=jenkins-hbase4.apache.org,35511,1675961620699}] 2023-02-09 16:54:26,484 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=32, ppid=29, state=RUNNABLE; OpenRegionProcedure 8c4f1be909138cea70e12c87de376ed7, server=jenkins-hbase4.apache.org,35511,1675961620699}] 2023-02-09 16:54:26,484 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=33, ppid=30, state=RUNNABLE; OpenRegionProcedure 3732f079659451c27d92f87ad081fc3c, server=jenkins-hbase4.apache.org,35511,1675961620699}] 2023-02-09 16:54:26,587 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:26,587 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:26,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-09 16:54:26,611 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/.tmp/family1/42c9997394684181b452a02f3d818edc as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1/42c9997394684181b452a02f3d818edc 2023-02-09 16:54:26,616 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in de35d6fbb4adad984ad971174d9fcf25/family1 of de35d6fbb4adad984ad971174d9fcf25 into 42c9997394684181b452a02f3d818edc(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-09 16:54:26,616 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for de35d6fbb4adad984ad971174d9fcf25: 2023-02-09 16:54:26,617 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1675961652483.de35d6fbb4adad984ad971174d9fcf25., storeName=family1, fileCount=3, fileSize=176.8 K (165.1 K, 6.6 K, 5.2 K), priority=2, time=1675961665349; duration=1sec 2023-02-09 16:54:26,617 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 16:54:26,638 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,1,1675961665479.8c4f1be909138cea70e12c87de376ed7. 2023-02-09 16:54:26,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 8c4f1be909138cea70e12c87de376ed7, NAME => 'testScannerOnBulkLoadRefHFiles,1,1675961665479.8c4f1be909138cea70e12c87de376ed7.', STARTKEY => '1', ENDKEY => '2'} 2023-02-09 16:54:26,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 8c4f1be909138cea70e12c87de376ed7 2023-02-09 16:54:26,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,1,1675961665479.8c4f1be909138cea70e12c87de376ed7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 16:54:26,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 8c4f1be909138cea70e12c87de376ed7 2023-02-09 16:54:26,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 8c4f1be909138cea70e12c87de376ed7 2023-02-09 16:54:26,639 INFO [StoreOpener-8c4f1be909138cea70e12c87de376ed7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 8c4f1be909138cea70e12c87de376ed7 2023-02-09 16:54:26,641 DEBUG [StoreOpener-8c4f1be909138cea70e12c87de376ed7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testScannerOnBulkLoadRefHFiles/8c4f1be909138cea70e12c87de376ed7/family1 2023-02-09 16:54:26,641 DEBUG [StoreOpener-8c4f1be909138cea70e12c87de376ed7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testScannerOnBulkLoadRefHFiles/8c4f1be909138cea70e12c87de376ed7/family1 2023-02-09 16:54:26,641 INFO [StoreOpener-8c4f1be909138cea70e12c87de376ed7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8c4f1be909138cea70e12c87de376ed7 columnFamilyName family1 2023-02-09 16:54:26,643 INFO [StoreOpener-8c4f1be909138cea70e12c87de376ed7-1] regionserver.HStore(310): Store=8c4f1be909138cea70e12c87de376ed7/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 16:54:26,643 INFO [StoreOpener-8c4f1be909138cea70e12c87de376ed7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 8c4f1be909138cea70e12c87de376ed7 2023-02-09 16:54:26,644 DEBUG [StoreOpener-8c4f1be909138cea70e12c87de376ed7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testScannerOnBulkLoadRefHFiles/8c4f1be909138cea70e12c87de376ed7/family2 2023-02-09 16:54:26,644 DEBUG [StoreOpener-8c4f1be909138cea70e12c87de376ed7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testScannerOnBulkLoadRefHFiles/8c4f1be909138cea70e12c87de376ed7/family2 2023-02-09 16:54:26,645 INFO [StoreOpener-8c4f1be909138cea70e12c87de376ed7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8c4f1be909138cea70e12c87de376ed7 columnFamilyName family2 2023-02-09 16:54:26,646 INFO [StoreOpener-8c4f1be909138cea70e12c87de376ed7-1] regionserver.HStore(310): Store=8c4f1be909138cea70e12c87de376ed7/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 16:54:26,647 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testScannerOnBulkLoadRefHFiles/8c4f1be909138cea70e12c87de376ed7 2023-02-09 16:54:26,647 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testScannerOnBulkLoadRefHFiles/8c4f1be909138cea70e12c87de376ed7 2023-02-09 16:54:26,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 16:54:26,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 8c4f1be909138cea70e12c87de376ed7 2023-02-09 16:54:26,655 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1/6c22f9d29d894da290984e6bf1ccc0c8, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1/297e0fa753c54037b82955c0fac91203, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1/7ebd993d4dd048a7adf38cbded1d62fc_SeqId_47_] to archive 2023-02-09 16:54:26,655 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testScannerOnBulkLoadRefHFiles/8c4f1be909138cea70e12c87de376ed7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 16:54:26,655 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 16:54:26,655 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 8c4f1be909138cea70e12c87de376ed7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68333436, jitterRate=0.018247544765472412}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 16:54:26,655 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 8c4f1be909138cea70e12c87de376ed7: Running coprocessor pre-open hook at 1675961666638Writing region info on filesystem at 1675961666638Initializing all the Stores at 1675961666639 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675961666639Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675961666639Cleaning up temporary data from old regions at 1675961666648 (+9 ms)Cleaning up detritus from prior splits at 1675961666648Running coprocessor post-open hooks at 1675961666655 (+7 ms)Region opened successfully at 1675961666655 2023-02-09 16:54:26,656 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,1,1675961665479.8c4f1be909138cea70e12c87de376ed7., pid=32, masterSystemTime=1675961666635 2023-02-09 16:54:26,657 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1/6c22f9d29d894da290984e6bf1ccc0c8 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1/6c22f9d29d894da290984e6bf1ccc0c8 2023-02-09 16:54:26,658 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,1,1675961665479.8c4f1be909138cea70e12c87de376ed7. 2023-02-09 16:54:26,658 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,1,1675961665479.8c4f1be909138cea70e12c87de376ed7. 2023-02-09 16:54:26,658 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,2,1675961665479.3732f079659451c27d92f87ad081fc3c. 2023-02-09 16:54:26,658 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3732f079659451c27d92f87ad081fc3c, NAME => 'testScannerOnBulkLoadRefHFiles,2,1675961665479.3732f079659451c27d92f87ad081fc3c.', STARTKEY => '2', ENDKEY => ''} 2023-02-09 16:54:26,659 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=8c4f1be909138cea70e12c87de376ed7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:26,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 3732f079659451c27d92f87ad081fc3c 2023-02-09 16:54:26,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,2,1675961665479.3732f079659451c27d92f87ad081fc3c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 16:54:26,659 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,1,1675961665479.8c4f1be909138cea70e12c87de376ed7.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1675961666659"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675961666659"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675961666659"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675961666659"}]},"ts":"1675961666659"} 2023-02-09 16:54:26,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 3732f079659451c27d92f87ad081fc3c 2023-02-09 16:54:26,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 3732f079659451c27d92f87ad081fc3c 2023-02-09 16:54:26,659 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1/297e0fa753c54037b82955c0fac91203 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1/297e0fa753c54037b82955c0fac91203 2023-02-09 16:54:26,660 INFO [StoreOpener-3732f079659451c27d92f87ad081fc3c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 3732f079659451c27d92f87ad081fc3c 2023-02-09 16:54:26,661 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1/7ebd993d4dd048a7adf38cbded1d62fc_SeqId_47_ to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/family1/7ebd993d4dd048a7adf38cbded1d62fc_SeqId_47_ 2023-02-09 16:54:26,662 DEBUG [StoreOpener-3732f079659451c27d92f87ad081fc3c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testScannerOnBulkLoadRefHFiles/3732f079659451c27d92f87ad081fc3c/family1 2023-02-09 16:54:26,662 DEBUG [StoreOpener-3732f079659451c27d92f87ad081fc3c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testScannerOnBulkLoadRefHFiles/3732f079659451c27d92f87ad081fc3c/family1 2023-02-09 16:54:26,663 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=32, resume processing ppid=29 2023-02-09 16:54:26,663 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=32, ppid=29, state=SUCCESS; OpenRegionProcedure 8c4f1be909138cea70e12c87de376ed7, server=jenkins-hbase4.apache.org,35511,1675961620699 in 178 msec 2023-02-09 16:54:26,663 INFO [StoreOpener-3732f079659451c27d92f87ad081fc3c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3732f079659451c27d92f87ad081fc3c columnFamilyName family1 2023-02-09 16:54:26,664 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=8c4f1be909138cea70e12c87de376ed7, ASSIGN in 339 msec 2023-02-09 16:54:26,664 INFO [StoreOpener-3732f079659451c27d92f87ad081fc3c-1] regionserver.HStore(310): Store=3732f079659451c27d92f87ad081fc3c/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 16:54:26,665 INFO [StoreOpener-3732f079659451c27d92f87ad081fc3c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 3732f079659451c27d92f87ad081fc3c 2023-02-09 16:54:26,666 DEBUG [StoreOpener-3732f079659451c27d92f87ad081fc3c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testScannerOnBulkLoadRefHFiles/3732f079659451c27d92f87ad081fc3c/family2 2023-02-09 16:54:26,666 DEBUG [StoreOpener-3732f079659451c27d92f87ad081fc3c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testScannerOnBulkLoadRefHFiles/3732f079659451c27d92f87ad081fc3c/family2 2023-02-09 16:54:26,667 INFO [StoreOpener-3732f079659451c27d92f87ad081fc3c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3732f079659451c27d92f87ad081fc3c columnFamilyName family2 2023-02-09 16:54:26,668 INFO [StoreOpener-3732f079659451c27d92f87ad081fc3c-1] regionserver.HStore(310): Store=3732f079659451c27d92f87ad081fc3c/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 16:54:26,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testScannerOnBulkLoadRefHFiles/3732f079659451c27d92f87ad081fc3c 2023-02-09 16:54:26,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testScannerOnBulkLoadRefHFiles/3732f079659451c27d92f87ad081fc3c 2023-02-09 16:54:26,671 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 16:54:26,672 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 3732f079659451c27d92f87ad081fc3c 2023-02-09 16:54:26,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testScannerOnBulkLoadRefHFiles/3732f079659451c27d92f87ad081fc3c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 16:54:26,674 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 3732f079659451c27d92f87ad081fc3c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73525386, jitterRate=0.09561362862586975}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 16:54:26,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 3732f079659451c27d92f87ad081fc3c: Running coprocessor pre-open hook at 1675961666659Writing region info on filesystem at 1675961666659Initializing all the Stores at 1675961666660 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675961666660Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675961666660Cleaning up temporary data from old regions at 1675961666670 (+10 ms)Cleaning up detritus from prior splits at 1675961666670Running coprocessor post-open hooks at 1675961666674 (+4 ms)Region opened successfully at 1675961666674 2023-02-09 16:54:26,675 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,2,1675961665479.3732f079659451c27d92f87ad081fc3c., pid=33, masterSystemTime=1675961666635 2023-02-09 16:54:26,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,2,1675961665479.3732f079659451c27d92f87ad081fc3c. 2023-02-09 16:54:26,677 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,2,1675961665479.3732f079659451c27d92f87ad081fc3c. 2023-02-09 16:54:26,677 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,,1675961665479.42b6e2ba1146417ba4c5be92498b1d58. 2023-02-09 16:54:26,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 42b6e2ba1146417ba4c5be92498b1d58, NAME => 'testScannerOnBulkLoadRefHFiles,,1675961665479.42b6e2ba1146417ba4c5be92498b1d58.', STARTKEY => '', ENDKEY => '1'} 2023-02-09 16:54:26,677 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=3732f079659451c27d92f87ad081fc3c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:26,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 42b6e2ba1146417ba4c5be92498b1d58 2023-02-09 16:54:26,677 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,2,1675961665479.3732f079659451c27d92f87ad081fc3c.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1675961666677"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675961666677"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675961666677"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675961666677"}]},"ts":"1675961666677"} 2023-02-09 16:54:26,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,,1675961665479.42b6e2ba1146417ba4c5be92498b1d58.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 16:54:26,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 42b6e2ba1146417ba4c5be92498b1d58 2023-02-09 16:54:26,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 42b6e2ba1146417ba4c5be92498b1d58 2023-02-09 16:54:26,679 INFO [StoreOpener-42b6e2ba1146417ba4c5be92498b1d58-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 42b6e2ba1146417ba4c5be92498b1d58 2023-02-09 16:54:26,680 DEBUG [StoreOpener-42b6e2ba1146417ba4c5be92498b1d58-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testScannerOnBulkLoadRefHFiles/42b6e2ba1146417ba4c5be92498b1d58/family1 2023-02-09 16:54:26,680 DEBUG [StoreOpener-42b6e2ba1146417ba4c5be92498b1d58-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testScannerOnBulkLoadRefHFiles/42b6e2ba1146417ba4c5be92498b1d58/family1 2023-02-09 16:54:26,681 INFO [StoreOpener-42b6e2ba1146417ba4c5be92498b1d58-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 42b6e2ba1146417ba4c5be92498b1d58 columnFamilyName family1 2023-02-09 16:54:26,681 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=33, resume processing ppid=30 2023-02-09 16:54:26,681 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=33, ppid=30, state=SUCCESS; OpenRegionProcedure 3732f079659451c27d92f87ad081fc3c, server=jenkins-hbase4.apache.org,35511,1675961620699 in 194 msec 2023-02-09 16:54:26,682 INFO [StoreOpener-42b6e2ba1146417ba4c5be92498b1d58-1] regionserver.HStore(310): Store=42b6e2ba1146417ba4c5be92498b1d58/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 16:54:26,682 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=3732f079659451c27d92f87ad081fc3c, ASSIGN in 357 msec 2023-02-09 16:54:26,682 INFO [StoreOpener-42b6e2ba1146417ba4c5be92498b1d58-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 42b6e2ba1146417ba4c5be92498b1d58 2023-02-09 16:54:26,683 DEBUG [StoreOpener-42b6e2ba1146417ba4c5be92498b1d58-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testScannerOnBulkLoadRefHFiles/42b6e2ba1146417ba4c5be92498b1d58/family2 2023-02-09 16:54:26,683 DEBUG [StoreOpener-42b6e2ba1146417ba4c5be92498b1d58-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testScannerOnBulkLoadRefHFiles/42b6e2ba1146417ba4c5be92498b1d58/family2 2023-02-09 16:54:26,683 INFO [StoreOpener-42b6e2ba1146417ba4c5be92498b1d58-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 42b6e2ba1146417ba4c5be92498b1d58 columnFamilyName family2 2023-02-09 16:54:26,684 INFO [StoreOpener-42b6e2ba1146417ba4c5be92498b1d58-1] regionserver.HStore(310): Store=42b6e2ba1146417ba4c5be92498b1d58/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 16:54:26,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testScannerOnBulkLoadRefHFiles/42b6e2ba1146417ba4c5be92498b1d58 2023-02-09 16:54:26,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testScannerOnBulkLoadRefHFiles/42b6e2ba1146417ba4c5be92498b1d58 2023-02-09 16:54:26,687 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 16:54:26,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 42b6e2ba1146417ba4c5be92498b1d58 2023-02-09 16:54:26,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testScannerOnBulkLoadRefHFiles/42b6e2ba1146417ba4c5be92498b1d58/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 16:54:26,691 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 42b6e2ba1146417ba4c5be92498b1d58; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69251900, jitterRate=0.031933724880218506}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 16:54:26,691 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 42b6e2ba1146417ba4c5be92498b1d58: Running coprocessor pre-open hook at 1675961666677Writing region info on filesystem at 1675961666677Initializing all the Stores at 1675961666678 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675961666678Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675961666678Cleaning up temporary data from old regions at 1675961666686 (+8 ms)Cleaning up detritus from prior splits at 1675961666687 (+1 ms)Running coprocessor post-open hooks at 1675961666691 (+4 ms)Region opened successfully at 1675961666691 2023-02-09 16:54:26,692 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,,1675961665479.42b6e2ba1146417ba4c5be92498b1d58., pid=31, masterSystemTime=1675961666635 2023-02-09 16:54:26,693 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,,1675961665479.42b6e2ba1146417ba4c5be92498b1d58. 2023-02-09 16:54:26,693 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,,1675961665479.42b6e2ba1146417ba4c5be92498b1d58. 2023-02-09 16:54:26,694 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=42b6e2ba1146417ba4c5be92498b1d58, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:26,694 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,,1675961665479.42b6e2ba1146417ba4c5be92498b1d58.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1675961666694"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675961666694"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675961666694"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675961666694"}]},"ts":"1675961666694"} 2023-02-09 16:54:26,697 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=28 2023-02-09 16:54:26,698 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure 42b6e2ba1146417ba4c5be92498b1d58, server=jenkins-hbase4.apache.org,35511,1675961620699 in 212 msec 2023-02-09 16:54:26,700 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-02-09 16:54:26,700 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=42b6e2ba1146417ba4c5be92498b1d58, ASSIGN in 374 msec 2023-02-09 16:54:26,700 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 16:54:26,701 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675961666700"}]},"ts":"1675961666700"} 2023-02-09 16:54:26,702 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLED in hbase:meta 2023-02-09 16:54:26,704 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 16:54:26,706 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles in 1.2250 sec 2023-02-09 16:54:27,588 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:27,589 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:27,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-09 16:54:27,590 INFO [Listener at localhost/41619] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testScannerOnBulkLoadRefHFiles, procId: 27 completed 2023-02-09 16:54:27,596 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:27,596 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:27,596 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:54:27,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-02-09 16:54:27,598 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-02-09 16:54:27,598 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:27,598 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-02-09 16:54:27,598 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-02-09 16:54:27,598 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-09 16:54:27,598 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-09 16:54:27,600 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:27,600 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:27,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:27,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:27,601 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:27,601 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:54:27,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-09 16:54:27,601 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-09 16:54:27,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:54:27,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-09 16:54:27,601 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-02-09 16:54:27,602 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-02-09 16:54:27,602 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-02-09 16:54:27,602 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:27,602 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-02-09 16:54:27,602 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1675961665479.3732f079659451c27d92f87ad081fc3c. 2023-02-09 16:54:27,602 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1675961665479.3732f079659451c27d92f87ad081fc3c. started... 2023-02-09 16:54:27,602 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1675961665479.8c4f1be909138cea70e12c87de376ed7. 2023-02-09 16:54:27,602 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1675961665479.42b6e2ba1146417ba4c5be92498b1d58. 2023-02-09 16:54:27,603 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 3732f079659451c27d92f87ad081fc3c 2/2 column families, dataSize=48 B heapSize=632 B 2023-02-09 16:54:27,603 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1675961665479.42b6e2ba1146417ba4c5be92498b1d58. started... 2023-02-09 16:54:27,602 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1675961665479.8c4f1be909138cea70e12c87de376ed7. started... 2023-02-09 16:54:27,602 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-09 16:54:27,603 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:54:27,603 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 42b6e2ba1146417ba4c5be92498b1d58: 2023-02-09 16:54:27,604 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 8c4f1be909138cea70e12c87de376ed7: 2023-02-09 16:54:27,604 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1675961665479.42b6e2ba1146417ba4c5be92498b1d58. 2023-02-09 16:54:27,604 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1675961665479.8c4f1be909138cea70e12c87de376ed7. 2023-02-09 16:54:27,604 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-09 16:54:27,604 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-09 16:54:28,016 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230209683cffbd1dfa4a28b1c40c1de908dbaf to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230209683cffbd1dfa4a28b1c40c1de908dbaf 2023-02-09 16:54:28,422 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=48, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testScannerOnBulkLoadRefHFiles/3732f079659451c27d92f87ad081fc3c/.tmp/family1/d2bbb9ed3fee42558038484382e58793 2023-02-09 16:54:28,427 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testScannerOnBulkLoadRefHFiles/3732f079659451c27d92f87ad081fc3c/.tmp/family1/d2bbb9ed3fee42558038484382e58793 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testScannerOnBulkLoadRefHFiles/3732f079659451c27d92f87ad081fc3c/family1/d2bbb9ed3fee42558038484382e58793 2023-02-09 16:54:28,431 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testScannerOnBulkLoadRefHFiles/3732f079659451c27d92f87ad081fc3c/family1/d2bbb9ed3fee42558038484382e58793, entries=1, sequenceid=5, filesize=4.9 K 2023-02-09 16:54:28,432 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~48 B/48, heapSize ~360 B/360, currentSize=0 B/0 for 3732f079659451c27d92f87ad081fc3c in 829ms, sequenceid=5, compaction requested=false 2023-02-09 16:54:28,432 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testScannerOnBulkLoadRefHFiles' 2023-02-09 16:54:28,433 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 3732f079659451c27d92f87ad081fc3c: 2023-02-09 16:54:28,433 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1675961665479.3732f079659451c27d92f87ad081fc3c. 2023-02-09 16:54:28,433 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-09 16:54:28,433 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-09 16:54:28,433 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:28,433 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-02-09 16:54:28,433 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-02-09 16:54:28,435 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-09 16:54:28,435 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:28,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:28,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:28,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:28,435 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-09 16:54:28,435 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:54:28,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:28,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:28,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-09 16:54:28,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:28,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:28,437 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-02-09 16:54:28,437 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3d4b23ff[Count = 0] remaining members to acquire global barrier 2023-02-09 16:54:28,437 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-02-09 16:54:28,437 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-09 16:54:28,439 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-09 16:54:28,439 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-09 16:54:28,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-09 16:54:28,439 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-02-09 16:54:28,439 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-02-09 16:54:28,439 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:54:28,439 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:28,439 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:54:28,440 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-02-09 16:54:28,440 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:28,440 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:28,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:28,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:28,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:28,440 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-02-09 16:54:28,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:28,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:28,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-09 16:54:28,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:28,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:28,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-09 16:54:28,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:28,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:54:28,444 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-02-09 16:54:28,444 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-02-09 16:54:28,444 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:54:28,444 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:54:28,444 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-02-09 16:54:28,444 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:54:28,446 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-09 16:54:28,446 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-09 16:54:28,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-09 16:54:28,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:28,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:28,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-09 16:54:28,447 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:28,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-09 16:54:28,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:28,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:28,447 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:28,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:28,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-09 16:54:28,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-09 16:54:28,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:28,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-09 16:54:28,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:28,448 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:28,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:28,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-09 16:54:28,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:28,453 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:28,453 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:28,453 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-09 16:54:28,453 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:28,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:28,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:28,453 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:28,453 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-09 16:54:28,453 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-02-09 16:54:28,453 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:54:28,453 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:28,454 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-09 16:54:28,454 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-09 16:54:28,454 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:28,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:28,454 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-09 16:54:28,454 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-02-09 16:54:28,454 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:54:28,554 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:54:28,554 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:28,554 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:28,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:54:28,558 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:28,559 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:28,559 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:54:28,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(143): Procedure testScannerOnBulkLoadRefHFiles was in running list but was completed. Accepting new attempt. 2023-02-09 16:54:28,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-02-09 16:54:28,561 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-02-09 16:54:28,561 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:28,561 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-02-09 16:54:28,561 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-02-09 16:54:28,561 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-09 16:54:28,561 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-09 16:54:28,562 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:28,562 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:28,563 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:28,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:28,563 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:28,563 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:54:28,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-09 16:54:28,563 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-09 16:54:28,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:54:28,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-09 16:54:28,564 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-02-09 16:54:28,564 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testScannerOnBulkLoadRefHFiles is still present, removing 2023-02-09 16:54:28,564 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-02-09 16:54:28,564 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-02-09 16:54:28,564 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:28,564 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-02-09 16:54:28,564 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1675961665479.3732f079659451c27d92f87ad081fc3c. 2023-02-09 16:54:28,564 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1675961665479.3732f079659451c27d92f87ad081fc3c. started... 2023-02-09 16:54:28,564 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1675961665479.8c4f1be909138cea70e12c87de376ed7. 2023-02-09 16:54:28,564 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 3732f079659451c27d92f87ad081fc3c 2/2 column families, dataSize=90 B heapSize=752 B 2023-02-09 16:54:28,564 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-09 16:54:28,564 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:54:28,564 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1675961665479.42b6e2ba1146417ba4c5be92498b1d58. 2023-02-09 16:54:28,564 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1675961665479.8c4f1be909138cea70e12c87de376ed7. started... 2023-02-09 16:54:28,565 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1675961665479.42b6e2ba1146417ba4c5be92498b1d58. started... 2023-02-09 16:54:28,565 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 8c4f1be909138cea70e12c87de376ed7: 2023-02-09 16:54:28,565 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1675961665479.8c4f1be909138cea70e12c87de376ed7. 2023-02-09 16:54:28,565 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 42b6e2ba1146417ba4c5be92498b1d58: 2023-02-09 16:54:28,565 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-09 16:54:28,565 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1675961665479.42b6e2ba1146417ba4c5be92498b1d58. 2023-02-09 16:54:28,565 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-09 16:54:28,580 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230209f384286186de4ff38eaaeb187a5d79a9 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230209f384286186de4ff38eaaeb187a5d79a9 2023-02-09 16:54:28,985 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=90, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testScannerOnBulkLoadRefHFiles/3732f079659451c27d92f87ad081fc3c/.tmp/family1/1940eac069e84b63a9ae2e4d9817941f 2023-02-09 16:54:28,990 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testScannerOnBulkLoadRefHFiles/3732f079659451c27d92f87ad081fc3c/.tmp/family1/1940eac069e84b63a9ae2e4d9817941f as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testScannerOnBulkLoadRefHFiles/3732f079659451c27d92f87ad081fc3c/family1/1940eac069e84b63a9ae2e4d9817941f 2023-02-09 16:54:28,995 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testScannerOnBulkLoadRefHFiles/3732f079659451c27d92f87ad081fc3c/family1/1940eac069e84b63a9ae2e4d9817941f, entries=2, sequenceid=9, filesize=5.0 K 2023-02-09 16:54:28,996 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~90 B/90, heapSize ~480 B/480, currentSize=0 B/0 for 3732f079659451c27d92f87ad081fc3c in 432ms, sequenceid=9, compaction requested=false 2023-02-09 16:54:28,996 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 3732f079659451c27d92f87ad081fc3c: 2023-02-09 16:54:28,996 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1675961665479.3732f079659451c27d92f87ad081fc3c. 2023-02-09 16:54:28,996 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-09 16:54:28,996 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-09 16:54:28,996 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:28,997 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-02-09 16:54:28,997 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-02-09 16:54:28,999 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:28,999 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-09 16:54:28,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:28,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:28,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:29,000 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-09 16:54:29,000 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:54:29,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:29,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:29,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-09 16:54:29,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:29,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:29,001 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-02-09 16:54:29,001 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@370c084e[Count = 0] remaining members to acquire global barrier 2023-02-09 16:54:29,001 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-02-09 16:54:29,001 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-09 16:54:29,002 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-09 16:54:29,002 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-09 16:54:29,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-09 16:54:29,003 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-02-09 16:54:29,003 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-02-09 16:54:29,003 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:54:29,003 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:29,003 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:54:29,004 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-02-09 16:54:29,004 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:29,004 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:29,004 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-02-09 16:54:29,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:29,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:29,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:29,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:29,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:29,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-09 16:54:29,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:29,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:29,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-09 16:54:29,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:29,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:54:29,006 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-02-09 16:54:29,006 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-02-09 16:54:29,006 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:54:29,006 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:54:29,006 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-02-09 16:54:29,006 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:54:29,008 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-09 16:54:29,008 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-09 16:54:29,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-09 16:54:29,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-09 16:54:29,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:29,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:29,008 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:29,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-09 16:54:29,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:29,009 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:29,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:29,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:29,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-09 16:54:29,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-09 16:54:29,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:29,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-09 16:54:29,010 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:29,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:29,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:29,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-09 16:54:29,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:29,013 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:29,013 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:29,013 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-09 16:54:29,013 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-02-09 16:54:29,013 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:54:29,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:29,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:29,013 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:29,013 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:29,013 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-09 16:54:29,013 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:29,013 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-09 16:54:29,013 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-02-09 16:54:29,013 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-02-09 16:54:29,013 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:54:29,013 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-09 16:54:29,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:29,013 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-09 16:54:29,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:29,113 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:54:29,113 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:29,114 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:29,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:54:29,121 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=41333] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testScannerOnBulkLoadRefHFiles 2023-02-09 16:54:29,123 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-02-09 16:54:29,123 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-02-09 16:54:29,124 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] mob.MobUtils(833): start MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 16:54:29,124 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675962269124 2023-02-09 16:54:29,125 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-09 16:54:29,125 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testScannerOnBulkLoadRefHFiles' and column 'family1' 2023-02-09 16:54:29,125 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-02-09 16:54:29,126 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] zookeeper.ReadOnlyZKClient(139): Connect 0x7d148e5c to 127.0.0.1:53887 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 16:54:29,130 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@29a4bb96, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 16:54:29,130 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230209 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-02-09 16:54:29,558 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230209489e4f073e82421a8d523969a42a9cae to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230209489e4f073e82421a8d523969a42a9cae 2023-02-09 16:54:29,559 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230209 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-02-09 16:54:29,575 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 16:54:29,576 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36406, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 16:54:29,584 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:29,584 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:29,585 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-09 16:54:29,587 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50332, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-09 16:54:29,597 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230209/family1/09b302bce45c4902a04650e514f9e04e first=Optional[k0] last=Optional[k1] 2023-02-09 16:54:29,597 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testScannerOnBulkLoadRefHFiles,2,1675961665479.3732f079659451c27d92f87ad081fc3c., hostname=jenkins-hbase4.apache.org,35511,1675961620699, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230209/family1/09b302bce45c4902a04650e514f9e04e}] 2023-02-09 16:54:29,602 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(763): Validating hfile at hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230209/family1/09b302bce45c4902a04650e514f9e04e for inclusion in 3732f079659451c27d92f87ad081fc3c/family1 2023-02-09 16:54:29,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(775): HFile bounds: first=k0 last=k1 2023-02-09 16:54:29,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(777): Region bounds: first=2 last= 2023-02-09 16:54:29,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HRegion(2445): Flush status journal for 3732f079659451c27d92f87ad081fc3c: 2023-02-09 16:54:29,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230209/family1/09b302bce45c4902a04650e514f9e04e to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testScannerOnBulkLoadRefHFiles__93kjvgsvt63pghf2fmeutjaetumu7io8smebj2btgc05ru83utppbdlnsl9csvm8/family1/09b302bce45c4902a04650e514f9e04e 2023-02-09 16:54:29,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testScannerOnBulkLoadRefHFiles__93kjvgsvt63pghf2fmeutjaetumu7io8smebj2btgc05ru83utppbdlnsl9csvm8/family1/09b302bce45c4902a04650e514f9e04e as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testScannerOnBulkLoadRefHFiles/3732f079659451c27d92f87ad081fc3c/family1/ad56d493bf96429d9582ad4a96582f48_SeqId_12_ 2023-02-09 16:54:29,609 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(849): Loaded HFile hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testScannerOnBulkLoadRefHFiles__93kjvgsvt63pghf2fmeutjaetumu7io8smebj2btgc05ru83utppbdlnsl9csvm8/family1/09b302bce45c4902a04650e514f9e04e into 3732f079659451c27d92f87ad081fc3c/family1 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testScannerOnBulkLoadRefHFiles/3732f079659451c27d92f87ad081fc3c/family1/ad56d493bf96429d9582ad4a96582f48_SeqId_12_ - updating store file list. 2023-02-09 16:54:29,612 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(882): Loaded HFile hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testScannerOnBulkLoadRefHFiles/3732f079659451c27d92f87ad081fc3c/family1/ad56d493bf96429d9582ad4a96582f48_SeqId_12_ into 3732f079659451c27d92f87ad081fc3c/family1 2023-02-09 16:54:29,612 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(855): Successfully loaded hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testScannerOnBulkLoadRefHFiles__93kjvgsvt63pghf2fmeutjaetumu7io8smebj2btgc05ru83utppbdlnsl9csvm8/family1/09b302bce45c4902a04650e514f9e04e into 3732f079659451c27d92f87ad081fc3c/family1 (new location: hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testScannerOnBulkLoadRefHFiles/3732f079659451c27d92f87ad081fc3c/family1/ad56d493bf96429d9582ad4a96582f48_SeqId_12_) 2023-02-09 16:54:29,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testScannerOnBulkLoadRefHFiles__93kjvgsvt63pghf2fmeutjaetumu7io8smebj2btgc05ru83utppbdlnsl9csvm8/family1/09b302bce45c4902a04650e514f9e04e 2023-02-09 16:54:29,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-09 16:54:29,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 15445 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-09 16:54:29,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(1912): 3732f079659451c27d92f87ad081fc3c/family1 is initiating minor compaction (all files) 2023-02-09 16:54:29,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@6e8dccbe; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 16:54:29,614 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 3732f079659451c27d92f87ad081fc3c/family1 in testScannerOnBulkLoadRefHFiles,2,1675961665479.3732f079659451c27d92f87ad081fc3c. 2023-02-09 16:54:29,614 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testScannerOnBulkLoadRefHFiles/3732f079659451c27d92f87ad081fc3c/family1/d2bbb9ed3fee42558038484382e58793, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testScannerOnBulkLoadRefHFiles/3732f079659451c27d92f87ad081fc3c/family1/1940eac069e84b63a9ae2e4d9817941f, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testScannerOnBulkLoadRefHFiles/3732f079659451c27d92f87ad081fc3c/family1/ad56d493bf96429d9582ad4a96582f48_SeqId_12_] into tmpdir=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testScannerOnBulkLoadRefHFiles/3732f079659451c27d92f87ad081fc3c/.tmp, totalSize=15.1 K 2023-02-09 16:54:29,615 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting d2bbb9ed3fee42558038484382e58793, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675961667590 2023-02-09 16:54:29,615 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting 1940eac069e84b63a9ae2e4d9817941f, keycount=2, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675961667590 2023-02-09 16:54:29,616 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting ad56d493bf96429d9582ad4a96582f48_SeqId_12_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675961667590 2023-02-09 16:54:29,616 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230209 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-02-09 16:54:29,617 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 16:54:29,619 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230209683cffbd1dfa4a28b1c40c1de908dbaf to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230209683cffbd1dfa4a28b1c40c1de908dbaf 2023-02-09 16:54:29,620 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230209f384286186de4ff38eaaeb187a5d79a9 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230209f384286186de4ff38eaaeb187a5d79a9 2023-02-09 16:54:29,620 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testScannerOnBulkLoadRefHFiles 2 expired mob files are deleted 2023-02-09 16:54:29,620 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230209' 2023-02-09 16:54:29,620 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230209 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-02-09 16:54:29,620 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-02-09 16:54:29,621 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] mob.MobUtils(840): end MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 16:54:29,622 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-02-09 16:54:29,623 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE in 500 msec 2023-02-09 16:54:29,626 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] throttle.PressureAwareThroughputController(145): 3732f079659451c27d92f87ad081fc3c#family1#compaction#38 average throughput is 0.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 16:54:29,661 INFO [Listener at localhost/41619] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=248 (was 255), OpenFileDescriptor=586 (was 600), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=197 (was 204), ProcessCount=168 (was 168), AvailableMemoryMB=3187 (was 3199) 2023-02-09 16:54:29,672 INFO [Listener at localhost/41619] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=248, OpenFileDescriptor=586, MaxFileDescriptor=60000, SystemLoadAverage=197, ProcessCount=168, AvailableMemoryMB=3186 2023-02-09 16:54:29,673 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:29,673 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:29,675 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-09 16:54:29,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:29,677 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 16:54:29,677 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyPolicy" procId is: 35 2023-02-09 16:54:29,678 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:29,678 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:29,678 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 16:54:29,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-09 16:54:29,679 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237 2023-02-09 16:54:29,680 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237 empty. 2023-02-09 16:54:29,680 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237 2023-02-09 16:54:29,680 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyPolicy regions 2023-02-09 16:54:29,779 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:29,779 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:29,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-09 16:54:29,980 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:29,980 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:29,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-09 16:54:30,088 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-02-09 16:54:30,090 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7671): creating {ENCODED => 30e984c82550d4e18563b5c25ccd6237, NAME => 'testMajorCompactionWithWeeklyPolicy,,1675961669674.30e984c82550d4e18563b5c25ccd6237.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp 2023-02-09 16:54:30,281 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:30,281 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:30,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-09 16:54:30,496 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyPolicy,,1675961669674.30e984c82550d4e18563b5c25ccd6237.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 16:54:30,496 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1603): Closing 30e984c82550d4e18563b5c25ccd6237, disabling compactions & flushes 2023-02-09 16:54:30,496 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyPolicy,,1675961669674.30e984c82550d4e18563b5c25ccd6237. 2023-02-09 16:54:30,496 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1675961669674.30e984c82550d4e18563b5c25ccd6237. 2023-02-09 16:54:30,496 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1675961669674.30e984c82550d4e18563b5c25ccd6237. after waiting 0 ms 2023-02-09 16:54:30,496 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1675961669674.30e984c82550d4e18563b5c25ccd6237. 2023-02-09 16:54:30,496 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyPolicy,,1675961669674.30e984c82550d4e18563b5c25ccd6237. 2023-02-09 16:54:30,496 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1557): Region close journal for 30e984c82550d4e18563b5c25ccd6237: Waiting for close lock at 1675961670496Disabling compacts and flushes for region at 1675961670496Disabling writes for close at 1675961670496Writing region close event to WAL at 1675961670496Closed at 1675961670496 2023-02-09 16:54:30,498 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 16:54:30,499 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyPolicy,,1675961669674.30e984c82550d4e18563b5c25ccd6237.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1675961670499"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675961670499"}]},"ts":"1675961670499"} 2023-02-09 16:54:30,501 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-09 16:54:30,502 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 16:54:30,502 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675961670502"}]},"ts":"1675961670502"} 2023-02-09 16:54:30,503 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-02-09 16:54:30,505 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=30e984c82550d4e18563b5c25ccd6237, ASSIGN}] 2023-02-09 16:54:30,507 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=30e984c82550d4e18563b5c25ccd6237, ASSIGN 2023-02-09 16:54:30,508 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=30e984c82550d4e18563b5c25ccd6237, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35511,1675961620699; forceNewPlan=false, retain=false 2023-02-09 16:54:30,658 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=30e984c82550d4e18563b5c25ccd6237, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:30,659 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyPolicy,,1675961669674.30e984c82550d4e18563b5c25ccd6237.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1675961670658"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675961670658"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675961670658"}]},"ts":"1675961670658"} 2023-02-09 16:54:30,661 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE; OpenRegionProcedure 30e984c82550d4e18563b5c25ccd6237, server=jenkins-hbase4.apache.org,35511,1675961620699}] 2023-02-09 16:54:30,782 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:30,783 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:30,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-09 16:54:30,815 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyPolicy,,1675961669674.30e984c82550d4e18563b5c25ccd6237. 2023-02-09 16:54:30,815 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 30e984c82550d4e18563b5c25ccd6237, NAME => 'testMajorCompactionWithWeeklyPolicy,,1675961669674.30e984c82550d4e18563b5c25ccd6237.', STARTKEY => '', ENDKEY => ''} 2023-02-09 16:54:30,816 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyPolicy 30e984c82550d4e18563b5c25ccd6237 2023-02-09 16:54:30,816 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyPolicy,,1675961669674.30e984c82550d4e18563b5c25ccd6237.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 16:54:30,816 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 30e984c82550d4e18563b5c25ccd6237 2023-02-09 16:54:30,816 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 30e984c82550d4e18563b5c25ccd6237 2023-02-09 16:54:30,817 INFO [StoreOpener-30e984c82550d4e18563b5c25ccd6237-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 30e984c82550d4e18563b5c25ccd6237 2023-02-09 16:54:30,818 DEBUG [StoreOpener-30e984c82550d4e18563b5c25ccd6237-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1 2023-02-09 16:54:30,818 DEBUG [StoreOpener-30e984c82550d4e18563b5c25ccd6237-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1 2023-02-09 16:54:30,819 INFO [StoreOpener-30e984c82550d4e18563b5c25ccd6237-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 30e984c82550d4e18563b5c25ccd6237 columnFamilyName family1 2023-02-09 16:54:30,820 INFO [StoreOpener-30e984c82550d4e18563b5c25ccd6237-1] regionserver.HStore(310): Store=30e984c82550d4e18563b5c25ccd6237/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 16:54:30,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237 2023-02-09 16:54:30,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237 2023-02-09 16:54:30,823 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 30e984c82550d4e18563b5c25ccd6237 2023-02-09 16:54:30,825 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 16:54:30,826 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 30e984c82550d4e18563b5c25ccd6237; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67297118, jitterRate=0.0028052031993865967}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 16:54:30,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 30e984c82550d4e18563b5c25ccd6237: Running coprocessor pre-open hook at 1675961670816Writing region info on filesystem at 1675961670816Initializing all the Stores at 1675961670817 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1675961670817Cleaning up temporary data from old regions at 1675961670821 (+4 ms)Cleaning up detritus from prior splits at 1675961670822 (+1 ms)Running coprocessor post-open hooks at 1675961670826 (+4 ms)Region opened successfully at 1675961670826 2023-02-09 16:54:30,826 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyPolicy,,1675961669674.30e984c82550d4e18563b5c25ccd6237., pid=37, masterSystemTime=1675961670812 2023-02-09 16:54:30,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyPolicy,,1675961669674.30e984c82550d4e18563b5c25ccd6237. 2023-02-09 16:54:30,828 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyPolicy,,1675961669674.30e984c82550d4e18563b5c25ccd6237. 2023-02-09 16:54:30,828 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=30e984c82550d4e18563b5c25ccd6237, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:30,829 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyPolicy,,1675961669674.30e984c82550d4e18563b5c25ccd6237.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1675961670828"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675961670828"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675961670828"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675961670828"}]},"ts":"1675961670828"} 2023-02-09 16:54:30,831 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-02-09 16:54:30,831 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; OpenRegionProcedure 30e984c82550d4e18563b5c25ccd6237, server=jenkins-hbase4.apache.org,35511,1675961620699 in 169 msec 2023-02-09 16:54:30,833 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=36, resume processing ppid=35 2023-02-09 16:54:30,833 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=30e984c82550d4e18563b5c25ccd6237, ASSIGN in 326 msec 2023-02-09 16:54:30,833 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 16:54:30,834 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675961670833"}]},"ts":"1675961670833"} 2023-02-09 16:54:30,834 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-02-09 16:54:30,836 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 16:54:30,838 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy in 1.1620 sec 2023-02-09 16:54:30,847 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testScannerOnBulkLoadRefHFiles/3732f079659451c27d92f87ad081fc3c/.tmp/family1/0e4faf369efc4ec894cf0418ffa71e81 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testScannerOnBulkLoadRefHFiles/3732f079659451c27d92f87ad081fc3c/family1/0e4faf369efc4ec894cf0418ffa71e81 2023-02-09 16:54:30,852 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 3732f079659451c27d92f87ad081fc3c/family1 of 3732f079659451c27d92f87ad081fc3c into 0e4faf369efc4ec894cf0418ffa71e81(size=5.1 K), total size for store is 5.1 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-09 16:54:30,852 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 3732f079659451c27d92f87ad081fc3c: 2023-02-09 16:54:30,852 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testScannerOnBulkLoadRefHFiles,2,1675961665479.3732f079659451c27d92f87ad081fc3c., storeName=family1, fileCount=3, fileSize=15.1 K (4.9 K, 5.0 K, 5.2 K), priority=2, time=1675961669614; duration=1sec 2023-02-09 16:54:30,853 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 16:54:30,955 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testScannerOnBulkLoadRefHFiles/3732f079659451c27d92f87ad081fc3c/family1/d2bbb9ed3fee42558038484382e58793, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testScannerOnBulkLoadRefHFiles/3732f079659451c27d92f87ad081fc3c/family1/1940eac069e84b63a9ae2e4d9817941f, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testScannerOnBulkLoadRefHFiles/3732f079659451c27d92f87ad081fc3c/family1/ad56d493bf96429d9582ad4a96582f48_SeqId_12_] to archive 2023-02-09 16:54:30,956 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 16:54:30,957 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testScannerOnBulkLoadRefHFiles/3732f079659451c27d92f87ad081fc3c/family1/d2bbb9ed3fee42558038484382e58793 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testScannerOnBulkLoadRefHFiles/3732f079659451c27d92f87ad081fc3c/family1/d2bbb9ed3fee42558038484382e58793 2023-02-09 16:54:30,959 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testScannerOnBulkLoadRefHFiles/3732f079659451c27d92f87ad081fc3c/family1/1940eac069e84b63a9ae2e4d9817941f to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testScannerOnBulkLoadRefHFiles/3732f079659451c27d92f87ad081fc3c/family1/1940eac069e84b63a9ae2e4d9817941f 2023-02-09 16:54:30,960 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testScannerOnBulkLoadRefHFiles/3732f079659451c27d92f87ad081fc3c/family1/ad56d493bf96429d9582ad4a96582f48_SeqId_12_ to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testScannerOnBulkLoadRefHFiles/3732f079659451c27d92f87ad081fc3c/family1/ad56d493bf96429d9582ad4a96582f48_SeqId_12_ 2023-02-09 16:54:31,784 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:31,784 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:31,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-09 16:54:31,785 INFO [Listener at localhost/41619] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyPolicy, procId: 35 completed 2023-02-09 16:54:31,809 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:31,809 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:31,809 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:54:31,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:31,811 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-09 16:54:31,811 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:31,811 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-09 16:54:31,811 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-09 16:54:31,811 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:31,811 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:31,813 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:31,813 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:31,813 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:31,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:31,813 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:31,813 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:54:31,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:31,814 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:31,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:54:31,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:31,814 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:31,814 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:31,814 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-09 16:54:31,814 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:31,814 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-09 16:54:31,815 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 16:54:31,815 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:54:31,815 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1675961669674.30e984c82550d4e18563b5c25ccd6237. 2023-02-09 16:54:31,815 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1675961669674.30e984c82550d4e18563b5c25ccd6237. started... 2023-02-09 16:54:31,815 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 30e984c82550d4e18563b5c25ccd6237 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-09 16:54:32,165 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-09 16:54:32,235 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130073ed035f1a64d82a7c52b25861ced5a to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130073ed035f1a64d82a7c52b25861ced5a 2023-02-09 16:54:32,639 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/.tmp/family1/2846f721918d4cb9897abbf15303f185 2023-02-09 16:54:32,645 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/.tmp/family1/2846f721918d4cb9897abbf15303f185 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1/2846f721918d4cb9897abbf15303f185 2023-02-09 16:54:32,650 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1/2846f721918d4cb9897abbf15303f185, entries=1000, sequenceid=5, filesize=165.1 K 2023-02-09 16:54:32,652 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 30e984c82550d4e18563b5c25ccd6237 in 836ms, sequenceid=5, compaction requested=false 2023-02-09 16:54:32,652 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyPolicy' 2023-02-09 16:54:32,652 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 30e984c82550d4e18563b5c25ccd6237: 2023-02-09 16:54:32,652 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1675961669674.30e984c82550d4e18563b5c25ccd6237. 2023-02-09 16:54:32,652 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 16:54:32,652 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 16:54:32,652 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:32,652 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-09 16:54:32,652 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-09 16:54:32,654 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:32,654 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:32,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:32,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:32,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:32,655 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:32,655 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:54:32,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:32,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:32,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:32,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:32,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:32,656 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-09 16:54:32,656 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2c084078[Count = 0] remaining members to acquire global barrier 2023-02-09 16:54:32,656 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-09 16:54:32,656 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:32,658 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:32,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:32,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:32,658 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-09 16:54:32,658 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:32,658 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:54:32,658 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-09 16:54:32,658 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:54:32,660 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-09 16:54:32,660 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:32,660 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:32,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:32,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:32,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:32,660 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-09 16:54:32,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:32,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:32,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:32,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:32,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:32,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:32,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:32,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:54:32,662 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-09 16:54:32,662 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-09 16:54:32,662 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:54:32,663 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:54:32,663 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:32,663 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:54:32,664 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:32,664 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:32,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:32,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:32,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:32,664 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:32,664 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:32,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:32,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:32,665 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:32,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:32,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:32,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:32,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:32,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:32,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:32,666 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:32,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:32,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:32,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:32,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:32,670 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:32,670 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:32,670 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:32,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:32,670 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-09 16:54:32,670 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-09 16:54:32,670 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:54:32,670 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:32,670 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:32,670 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:32,670 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:32,670 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:32,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:32,670 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:32,670 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 16:54:32,670 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:54:32,670 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:32,671 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:32,671 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:32,771 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:54:32,771 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:32,771 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:32,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:54:32,775 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:32,775 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:32,776 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:54:32,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 16:54:32,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:32,777 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-09 16:54:32,777 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:32,777 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-09 16:54:32,778 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-09 16:54:32,778 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:32,778 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:32,779 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:32,779 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:32,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:32,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:32,780 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:32,780 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:54:32,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:32,780 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:32,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:54:32,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:32,781 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:32,781 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-09 16:54:32,781 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:32,781 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-09 16:54:32,781 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:32,781 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-09 16:54:32,781 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 16:54:32,781 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:54:32,781 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1675961669674.30e984c82550d4e18563b5c25ccd6237. 2023-02-09 16:54:32,781 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1675961669674.30e984c82550d4e18563b5c25ccd6237. started... 2023-02-09 16:54:32,782 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 30e984c82550d4e18563b5c25ccd6237 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-09 16:54:32,795 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511284cb47e11a2674e67bf38326348a64fd9 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511284cb47e11a2674e67bf38326348a64fd9 2023-02-09 16:54:32,801 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/.tmp/family1/f9876ca6c2d643e59d364e1f2299241e 2023-02-09 16:54:32,806 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/.tmp/family1/f9876ca6c2d643e59d364e1f2299241e as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1/f9876ca6c2d643e59d364e1f2299241e 2023-02-09 16:54:32,810 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1/f9876ca6c2d643e59d364e1f2299241e, entries=1, sequenceid=9, filesize=5.0 K 2023-02-09 16:54:32,811 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 30e984c82550d4e18563b5c25ccd6237 in 29ms, sequenceid=9, compaction requested=false 2023-02-09 16:54:32,811 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 30e984c82550d4e18563b5c25ccd6237: 2023-02-09 16:54:32,812 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1675961669674.30e984c82550d4e18563b5c25ccd6237. 2023-02-09 16:54:32,812 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 16:54:32,812 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 16:54:32,812 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:32,812 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-09 16:54:32,812 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-09 16:54:32,813 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:32,813 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:32,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:32,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:32,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:32,814 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:32,814 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:54:32,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:32,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:32,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:32,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:32,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:32,816 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-09 16:54:32,816 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@31c7a848[Count = 0] remaining members to acquire global barrier 2023-02-09 16:54:32,816 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-09 16:54:32,816 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:32,821 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:32,821 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:32,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:32,822 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-09 16:54:32,822 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-09 16:54:32,822 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:54:32,822 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:32,822 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:54:32,823 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:32,823 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-09 16:54:32,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:32,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:32,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:32,823 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:32,824 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-09 16:54:32,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:32,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:32,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:32,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:32,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:32,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:32,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:32,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:54:32,826 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-09 16:54:32,826 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-09 16:54:32,826 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:54:32,826 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:54:32,827 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:32,827 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:54:32,828 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:32,828 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:32,828 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:32,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:32,828 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:32,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:32,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:32,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:32,829 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:32,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:32,829 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:32,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:32,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:32,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:32,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:32,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:32,830 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:32,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:32,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:32,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:32,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:32,832 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:32,832 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:32,832 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:32,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:32,832 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:32,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:32,832 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:32,833 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:32,832 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:32,833 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-09 16:54:32,833 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:54:32,833 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:32,833 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:32,833 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:32,833 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:32,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:32,833 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 16:54:32,833 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-09 16:54:32,833 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:54:32,933 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:54:32,934 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:32,934 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:32,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:54:32,938 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:32,938 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:32,939 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:54:32,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 16:54:32,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:32,940 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-09 16:54:32,940 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:32,940 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-09 16:54:32,940 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-09 16:54:32,941 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:32,941 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:32,942 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:32,942 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:32,942 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:32,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:32,942 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:32,942 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:54:32,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:32,943 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:32,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:54:32,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:32,943 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:32,943 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-09 16:54:32,943 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:32,943 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-09 16:54:32,943 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:32,943 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-09 16:54:32,944 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 16:54:32,944 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:54:32,944 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1675961669674.30e984c82550d4e18563b5c25ccd6237. 2023-02-09 16:54:32,944 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1675961669674.30e984c82550d4e18563b5c25ccd6237. started... 2023-02-09 16:54:32,944 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 30e984c82550d4e18563b5c25ccd6237 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 16:54:33,357 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201e390baa3b3dd40d39bcde1905d4f8fdd to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201e390baa3b3dd40d39bcde1905d4f8fdd 2023-02-09 16:54:33,764 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/.tmp/family1/692b76c234d34e42b538fd62b546dffe 2023-02-09 16:54:33,769 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/.tmp/family1/692b76c234d34e42b538fd62b546dffe as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1/692b76c234d34e42b538fd62b546dffe 2023-02-09 16:54:33,772 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1/692b76c234d34e42b538fd62b546dffe, entries=1, sequenceid=13, filesize=4.9 K 2023-02-09 16:54:33,773 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 30e984c82550d4e18563b5c25ccd6237 in 829ms, sequenceid=13, compaction requested=true 2023-02-09 16:54:33,774 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 30e984c82550d4e18563b5c25ccd6237: 2023-02-09 16:54:33,774 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1675961669674.30e984c82550d4e18563b5c25ccd6237. 2023-02-09 16:54:33,774 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 16:54:33,774 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 16:54:33,774 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:33,774 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-09 16:54:33,774 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-09 16:54:33,776 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:33,776 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:33,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:33,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:33,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:33,776 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:33,776 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:54:33,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:33,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:33,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:33,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:33,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:33,777 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-09 16:54:33,777 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@55f72154[Count = 0] remaining members to acquire global barrier 2023-02-09 16:54:33,777 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-09 16:54:33,777 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:33,779 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:33,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:33,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:33,779 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-09 16:54:33,779 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-09 16:54:33,779 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:54:33,779 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:33,780 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:54:33,781 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:33,781 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-09 16:54:33,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:33,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:33,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:33,781 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:33,781 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-09 16:54:33,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:33,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:33,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:33,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:33,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:33,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:33,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:33,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:54:33,783 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-09 16:54:33,783 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-09 16:54:33,783 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:54:33,783 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:54:33,783 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:33,783 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:54:33,785 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:33,785 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:33,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:33,785 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:33,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:33,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:33,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:33,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:33,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:33,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:33,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:33,786 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:33,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:33,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:33,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:33,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:33,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:33,787 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:33,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:33,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:33,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:33,789 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:33,789 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:33,789 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:33,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:33,789 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-09 16:54:33,789 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:33,789 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-09 16:54:33,789 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:54:33,789 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:33,789 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:33,789 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:33,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:33,789 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:33,790 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:33,790 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:33,790 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 16:54:33,790 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:54:33,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:33,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:33,890 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:54:33,890 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:33,890 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:33,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:54:33,894 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:33,895 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:33,895 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:54:33,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 16:54:33,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:33,897 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-09 16:54:33,897 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:33,897 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-09 16:54:33,897 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-09 16:54:33,897 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:33,897 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:33,900 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:33,900 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:33,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:33,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:33,900 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:33,900 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:54:33,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:33,901 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:33,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:54:33,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:33,901 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:33,901 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-09 16:54:33,901 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:33,901 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-09 16:54:33,901 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:33,901 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-09 16:54:33,901 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 16:54:33,902 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:54:33,902 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1675961669674.30e984c82550d4e18563b5c25ccd6237. 2023-02-09 16:54:33,902 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1675961669674.30e984c82550d4e18563b5c25ccd6237. started... 2023-02-09 16:54:33,902 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 30e984c82550d4e18563b5c25ccd6237 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 16:54:34,314 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205980821c684af4f58a0e47520e9b7b172 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205980821c684af4f58a0e47520e9b7b172 2023-02-09 16:54:34,720 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/.tmp/family1/1284cab86682432d93d2dcb955dc6048 2023-02-09 16:54:34,725 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/.tmp/family1/1284cab86682432d93d2dcb955dc6048 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1/1284cab86682432d93d2dcb955dc6048 2023-02-09 16:54:34,729 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1/1284cab86682432d93d2dcb955dc6048, entries=1, sequenceid=17, filesize=4.9 K 2023-02-09 16:54:34,730 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 30e984c82550d4e18563b5c25ccd6237 in 828ms, sequenceid=17, compaction requested=true 2023-02-09 16:54:34,730 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 30e984c82550d4e18563b5c25ccd6237: 2023-02-09 16:54:34,730 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1675961669674.30e984c82550d4e18563b5c25ccd6237. 2023-02-09 16:54:34,730 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 16:54:34,730 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 16:54:34,730 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:34,730 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-09 16:54:34,730 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-09 16:54:34,732 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:34,732 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:34,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:34,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:34,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:34,732 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:34,732 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:54:34,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:34,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:34,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:34,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:34,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:34,734 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-09 16:54:34,734 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2ee1ddc[Count = 0] remaining members to acquire global barrier 2023-02-09 16:54:34,734 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-09 16:54:34,734 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:34,735 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:34,735 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:34,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:34,735 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-09 16:54:34,735 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-09 16:54:34,735 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:54:34,735 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:34,735 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:54:34,736 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-09 16:54:34,736 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:34,736 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:34,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:34,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:34,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:34,736 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-09 16:54:34,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:34,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:34,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:34,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:34,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:34,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:34,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:34,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:54:34,738 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-09 16:54:34,738 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-09 16:54:34,738 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:54:34,738 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:54:34,739 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:34,739 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:54:34,741 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:34,741 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:34,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:34,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:34,741 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:34,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:34,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:34,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:34,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:34,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:34,741 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:34,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:34,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:34,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:34,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:34,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:34,742 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:34,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:34,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:34,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:34,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:34,744 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:34,744 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:34,744 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:34,744 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:34,745 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-09 16:54:34,744 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:34,744 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-09 16:54:34,745 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:54:34,744 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:34,744 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:34,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:34,745 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:34,745 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:34,745 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:34,745 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 16:54:34,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:34,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:34,745 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:34,745 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:54:34,845 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:54:34,846 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:34,846 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:34,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:54:34,850 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:34,850 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:34,851 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:54:34,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 16:54:34,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:34,852 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-09 16:54:34,852 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:34,852 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-09 16:54:34,852 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-09 16:54:34,853 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:34,853 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:34,854 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:34,854 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:34,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:34,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:34,854 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:34,854 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:54:34,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:34,855 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:34,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:54:34,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:34,855 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:34,855 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-09 16:54:34,855 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:34,855 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-09 16:54:34,856 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:34,856 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-09 16:54:34,856 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 16:54:34,856 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:54:34,856 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1675961669674.30e984c82550d4e18563b5c25ccd6237. 2023-02-09 16:54:34,856 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1675961669674.30e984c82550d4e18563b5c25ccd6237. started... 2023-02-09 16:54:34,856 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 30e984c82550d4e18563b5c25ccd6237 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 16:54:35,268 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015122859aa51e102ec4cf19c1420f7416c80cb to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015122859aa51e102ec4cf19c1420f7416c80cb 2023-02-09 16:54:35,673 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/.tmp/family1/927bbd2d566c4fb4913e0f04a0e57cd4 2023-02-09 16:54:35,679 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/.tmp/family1/927bbd2d566c4fb4913e0f04a0e57cd4 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1/927bbd2d566c4fb4913e0f04a0e57cd4 2023-02-09 16:54:35,684 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1/927bbd2d566c4fb4913e0f04a0e57cd4, entries=1, sequenceid=21, filesize=4.9 K 2023-02-09 16:54:35,685 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 30e984c82550d4e18563b5c25ccd6237 in 829ms, sequenceid=21, compaction requested=true 2023-02-09 16:54:35,685 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 30e984c82550d4e18563b5c25ccd6237: 2023-02-09 16:54:35,685 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1675961669674.30e984c82550d4e18563b5c25ccd6237. 2023-02-09 16:54:35,685 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 16:54:35,685 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 16:54:35,685 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:35,686 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-09 16:54:35,686 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-09 16:54:35,692 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:35,692 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:35,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:35,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:35,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:35,692 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:35,693 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:54:35,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:35,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:35,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:35,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:35,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:35,694 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-09 16:54:35,694 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6c8b9679[Count = 0] remaining members to acquire global barrier 2023-02-09 16:54:35,694 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-09 16:54:35,695 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:35,696 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:35,696 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:35,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:35,696 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-09 16:54:35,696 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-09 16:54:35,696 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:54:35,696 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:35,696 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:54:35,697 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-09 16:54:35,697 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:35,697 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:35,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:35,697 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-09 16:54:35,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:35,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:35,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:35,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:35,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:35,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:35,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:35,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:35,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:35,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:54:35,700 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-09 16:54:35,700 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-09 16:54:35,700 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:54:35,700 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:54:35,700 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:35,700 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:54:35,703 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:35,703 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:35,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:35,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:35,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:35,704 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:35,704 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:35,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:35,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:35,704 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:35,704 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:35,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:35,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:35,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:35,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:35,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:35,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:35,706 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:35,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:35,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:35,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:35,710 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:35,710 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:35,710 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:35,710 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:35,710 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-09 16:54:35,710 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:54:35,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:35,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:35,710 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:35,710 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-09 16:54:35,710 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:35,710 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:35,710 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 16:54:35,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:35,710 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:35,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:35,711 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:54:35,711 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:35,711 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:35,811 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:54:35,811 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:35,811 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:35,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:54:35,817 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:35,817 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:35,817 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:54:35,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 16:54:35,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:35,819 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-09 16:54:35,819 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:35,819 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-09 16:54:35,819 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-09 16:54:35,820 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:35,820 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:35,821 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:35,821 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:35,821 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:35,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:35,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:35,822 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:35,822 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:54:35,822 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:35,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:54:35,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:35,822 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:35,823 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-09 16:54:35,823 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:35,823 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-09 16:54:35,823 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:35,823 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-09 16:54:35,827 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 16:54:35,828 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:54:35,828 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1675961669674.30e984c82550d4e18563b5c25ccd6237. 2023-02-09 16:54:35,828 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1675961669674.30e984c82550d4e18563b5c25ccd6237. started... 2023-02-09 16:54:35,828 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 30e984c82550d4e18563b5c25ccd6237 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 16:54:36,246 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231b5f72c600e3f4b9ea4aa09530f840483 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231b5f72c600e3f4b9ea4aa09530f840483 2023-02-09 16:54:36,652 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/.tmp/family1/87ac001defcc4339a52e673ef9250336 2023-02-09 16:54:36,656 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/.tmp/family1/87ac001defcc4339a52e673ef9250336 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1/87ac001defcc4339a52e673ef9250336 2023-02-09 16:54:36,660 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1/87ac001defcc4339a52e673ef9250336, entries=1, sequenceid=25, filesize=4.9 K 2023-02-09 16:54:36,661 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 30e984c82550d4e18563b5c25ccd6237 in 833ms, sequenceid=25, compaction requested=true 2023-02-09 16:54:36,662 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 30e984c82550d4e18563b5c25ccd6237: 2023-02-09 16:54:36,662 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1675961669674.30e984c82550d4e18563b5c25ccd6237. 2023-02-09 16:54:36,662 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 16:54:36,662 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 16:54:36,662 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:36,662 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-09 16:54:36,662 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-09 16:54:36,664 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:36,664 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:36,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:36,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:36,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:36,665 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:36,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:36,665 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:54:36,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:36,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:36,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:36,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:36,666 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-09 16:54:36,666 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6002f648[Count = 0] remaining members to acquire global barrier 2023-02-09 16:54:36,666 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-09 16:54:36,666 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:36,667 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:36,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:36,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:36,667 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-09 16:54:36,667 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-09 16:54:36,667 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:36,667 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:54:36,667 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:54:36,669 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-09 16:54:36,669 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:36,669 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:36,669 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-09 16:54:36,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:36,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:36,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:36,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:36,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:36,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:36,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:36,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:36,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:36,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:36,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:54:36,671 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-09 16:54:36,671 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-09 16:54:36,671 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:54:36,671 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:54:36,671 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:36,671 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:54:36,672 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:36,672 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:36,672 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:36,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:36,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:36,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:36,672 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:36,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:36,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:36,673 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:36,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:36,673 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:36,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:36,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:36,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:36,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:36,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:36,674 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:36,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:36,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:36,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:36,676 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:36,676 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:36,676 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:36,676 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:36,676 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:36,676 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:36,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:36,677 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-09 16:54:36,676 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-09 16:54:36,677 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:54:36,676 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:36,677 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:36,677 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:36,677 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:36,677 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:36,677 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 16:54:36,677 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:54:36,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:36,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:36,777 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:54:36,777 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:36,778 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:36,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:54:36,782 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:36,782 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:36,782 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:54:36,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 16:54:36,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:36,784 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-09 16:54:36,784 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:36,784 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-09 16:54:36,784 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-09 16:54:36,784 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:36,784 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:36,785 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:36,786 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:36,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:36,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:36,786 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:36,786 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:54:36,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:36,786 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:36,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:54:36,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:36,786 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:36,787 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-09 16:54:36,787 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:36,787 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-09 16:54:36,787 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:36,787 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-09 16:54:36,787 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 16:54:36,787 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:54:36,787 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1675961669674.30e984c82550d4e18563b5c25ccd6237. 2023-02-09 16:54:36,787 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1675961669674.30e984c82550d4e18563b5c25ccd6237. started... 2023-02-09 16:54:36,787 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 30e984c82550d4e18563b5c25ccd6237 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 16:54:37,204 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601014f512138ed084909ba6e7dc2fc87296c to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601014f512138ed084909ba6e7dc2fc87296c 2023-02-09 16:54:37,610 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/.tmp/family1/d08fb67aabc749e09f862b5df575294b 2023-02-09 16:54:37,615 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/.tmp/family1/d08fb67aabc749e09f862b5df575294b as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1/d08fb67aabc749e09f862b5df575294b 2023-02-09 16:54:37,619 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1/d08fb67aabc749e09f862b5df575294b, entries=1, sequenceid=29, filesize=4.9 K 2023-02-09 16:54:37,619 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 30e984c82550d4e18563b5c25ccd6237 in 832ms, sequenceid=29, compaction requested=true 2023-02-09 16:54:37,619 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 30e984c82550d4e18563b5c25ccd6237: 2023-02-09 16:54:37,619 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1675961669674.30e984c82550d4e18563b5c25ccd6237. 2023-02-09 16:54:37,619 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 16:54:37,620 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 16:54:37,620 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:37,620 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-09 16:54:37,620 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-09 16:54:37,621 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:37,621 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:37,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:37,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:37,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:37,621 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:37,621 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:54:37,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:37,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:37,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:37,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:37,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:37,623 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-09 16:54:37,623 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@c13869d[Count = 0] remaining members to acquire global barrier 2023-02-09 16:54:37,623 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-09 16:54:37,623 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:37,624 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:37,624 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:37,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:37,624 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-09 16:54:37,624 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-09 16:54:37,624 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:54:37,624 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:37,624 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:54:37,626 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-09 16:54:37,626 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:37,626 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:37,626 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-09 16:54:37,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:37,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:37,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:37,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:37,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:37,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:37,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:37,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:37,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:37,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:37,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:54:37,629 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-09 16:54:37,629 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-09 16:54:37,629 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:54:37,629 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:54:37,629 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:37,629 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:54:37,630 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:37,630 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:37,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:37,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:37,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:37,630 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:37,630 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:37,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:37,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:37,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:37,631 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:37,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:37,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:37,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:37,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:37,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:37,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:37,632 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:37,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:37,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:37,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:37,636 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:37,636 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:37,636 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:37,636 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:37,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:37,636 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:37,636 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-09 16:54:37,637 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:54:37,636 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:37,636 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:37,637 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:37,637 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:37,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:37,637 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:37,637 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 16:54:37,637 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:54:37,637 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:37,637 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:37,737 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:54:37,737 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:37,737 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:37,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:54:37,741 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:37,741 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:37,742 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:54:37,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 16:54:37,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:37,744 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-09 16:54:37,744 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:37,744 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-09 16:54:37,744 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-09 16:54:37,744 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:37,744 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:37,747 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:37,747 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:37,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:37,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:37,747 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:37,747 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:54:37,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:37,748 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:37,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:54:37,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:37,748 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:37,748 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-09 16:54:37,748 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:37,748 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-09 16:54:37,748 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:37,748 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-09 16:54:37,749 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 16:54:37,749 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:54:37,749 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1675961669674.30e984c82550d4e18563b5c25ccd6237. 2023-02-09 16:54:37,749 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1675961669674.30e984c82550d4e18563b5c25ccd6237. started... 2023-02-09 16:54:37,749 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 30e984c82550d4e18563b5c25ccd6237 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 16:54:38,161 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103881aa4d6120c4cabb7d5a3cd8bca6a89 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103881aa4d6120c4cabb7d5a3cd8bca6a89 2023-02-09 16:54:38,566 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/.tmp/family1/f0ec1f06fcca41b38a2dc59eb454a219 2023-02-09 16:54:38,571 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/.tmp/family1/f0ec1f06fcca41b38a2dc59eb454a219 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1/f0ec1f06fcca41b38a2dc59eb454a219 2023-02-09 16:54:38,575 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1/f0ec1f06fcca41b38a2dc59eb454a219, entries=1, sequenceid=33, filesize=4.9 K 2023-02-09 16:54:38,576 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 30e984c82550d4e18563b5c25ccd6237 in 827ms, sequenceid=33, compaction requested=true 2023-02-09 16:54:38,576 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 30e984c82550d4e18563b5c25ccd6237: 2023-02-09 16:54:38,576 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1675961669674.30e984c82550d4e18563b5c25ccd6237. 2023-02-09 16:54:38,576 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 16:54:38,577 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 16:54:38,577 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:38,577 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-09 16:54:38,577 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-09 16:54:38,578 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:38,578 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:38,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:38,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:38,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:38,579 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:38,579 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:54:38,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:38,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:38,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:38,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:38,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:38,580 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-09 16:54:38,580 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7e616a3e[Count = 0] remaining members to acquire global barrier 2023-02-09 16:54:38,580 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-09 16:54:38,580 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:38,581 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:38,581 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:38,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:38,581 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-09 16:54:38,581 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-09 16:54:38,581 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:54:38,581 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:38,581 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:54:38,582 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-09 16:54:38,582 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:38,582 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:38,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:38,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:38,582 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-09 16:54:38,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:38,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:38,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:38,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:38,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:38,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:38,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:38,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:38,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:54:38,584 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-09 16:54:38,584 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-09 16:54:38,584 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:54:38,584 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:54:38,584 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:38,584 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:54:38,587 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:38,587 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:38,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:38,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:38,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:38,587 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:38,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:38,587 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:38,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:38,587 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:38,587 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:38,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:38,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:38,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:38,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:38,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:38,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:38,588 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:38,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:38,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:38,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:38,590 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:38,590 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:38,590 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:38,590 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:38,590 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:38,590 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:38,590 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:38,590 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-09 16:54:38,591 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:54:38,590 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:38,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:38,591 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:38,591 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:38,591 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:38,591 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 16:54:38,591 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:38,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:38,591 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:54:38,691 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:54:38,691 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:38,691 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:38,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:54:38,696 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:38,696 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:38,697 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:54:38,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 16:54:38,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:38,699 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-09 16:54:38,699 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:38,699 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-09 16:54:38,699 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-09 16:54:38,699 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:38,699 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:38,701 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:38,701 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:38,701 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:38,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:38,701 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:38,701 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:54:38,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:38,701 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:38,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:54:38,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:38,702 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:38,702 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-09 16:54:38,702 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:38,702 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-09 16:54:38,702 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:38,702 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-09 16:54:38,702 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 16:54:38,702 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:54:38,702 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1675961669674.30e984c82550d4e18563b5c25ccd6237. 2023-02-09 16:54:38,702 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1675961669674.30e984c82550d4e18563b5c25ccd6237. started... 2023-02-09 16:54:38,703 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 30e984c82550d4e18563b5c25ccd6237 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 16:54:39,115 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907dde36e1d738c491a8a63f4c6f1ce5976 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20150907dde36e1d738c491a8a63f4c6f1ce5976 2023-02-09 16:54:39,520 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/.tmp/family1/73680fa9ee6448b69cab8d9d5944390d 2023-02-09 16:54:39,525 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/.tmp/family1/73680fa9ee6448b69cab8d9d5944390d as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1/73680fa9ee6448b69cab8d9d5944390d 2023-02-09 16:54:39,529 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1/73680fa9ee6448b69cab8d9d5944390d, entries=1, sequenceid=37, filesize=4.9 K 2023-02-09 16:54:39,529 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 30e984c82550d4e18563b5c25ccd6237 in 826ms, sequenceid=37, compaction requested=true 2023-02-09 16:54:39,530 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 30e984c82550d4e18563b5c25ccd6237: 2023-02-09 16:54:39,530 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1675961669674.30e984c82550d4e18563b5c25ccd6237. 2023-02-09 16:54:39,530 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 16:54:39,530 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 16:54:39,530 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:39,530 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-09 16:54:39,530 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-09 16:54:39,531 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:39,531 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:39,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:39,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:39,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:39,531 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:39,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:39,531 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:54:39,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:39,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:39,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:39,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:39,533 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-09 16:54:39,533 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-09 16:54:39,533 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4e6913d5[Count = 0] remaining members to acquire global barrier 2023-02-09 16:54:39,533 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:39,535 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:39,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:39,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:39,535 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-09 16:54:39,535 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-09 16:54:39,535 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:54:39,535 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:39,535 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:54:39,536 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-09 16:54:39,536 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:39,536 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:39,536 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-09 16:54:39,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:39,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:39,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:39,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:39,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:39,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:39,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:39,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:39,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:39,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:39,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:54:39,539 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-09 16:54:39,539 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-09 16:54:39,539 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:54:39,539 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:54:39,539 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:39,539 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:54:39,541 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:39,541 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:39,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:39,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:39,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:39,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:39,541 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:39,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:39,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:39,541 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:39,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:39,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:39,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:39,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:39,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:39,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:39,542 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:39,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:39,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:39,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:39,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:39,544 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:39,544 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:39,544 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:39,544 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-09 16:54:39,544 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:54:39,544 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:39,544 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:39,544 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:39,544 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-09 16:54:39,544 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:39,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:39,544 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:39,545 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 16:54:39,545 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:39,545 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:54:39,545 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:39,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:39,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:39,545 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:39,645 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:54:39,645 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:39,645 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:39,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:54:39,649 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:39,650 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:39,650 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:54:39,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 16:54:39,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:39,652 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-09 16:54:39,652 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:39,652 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-09 16:54:39,652 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-09 16:54:39,652 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:39,652 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:39,654 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:39,654 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:39,654 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:39,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:39,654 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:39,654 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:54:39,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:39,655 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:39,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:54:39,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:39,655 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:39,655 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-09 16:54:39,655 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:39,655 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-09 16:54:39,655 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:39,655 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-09 16:54:39,655 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 16:54:39,655 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:54:39,656 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1675961669674.30e984c82550d4e18563b5c25ccd6237. 2023-02-09 16:54:39,656 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1675961669674.30e984c82550d4e18563b5c25ccd6237. started... 2023-02-09 16:54:39,656 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 30e984c82550d4e18563b5c25ccd6237 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 16:54:40,068 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511203637f533f29144e9a85b1f90c4aa2e1d to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511203637f533f29144e9a85b1f90c4aa2e1d 2023-02-09 16:54:40,473 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/.tmp/family1/a9a5e693d658482e9b378c99261c7ea5 2023-02-09 16:54:40,479 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/.tmp/family1/a9a5e693d658482e9b378c99261c7ea5 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1/a9a5e693d658482e9b378c99261c7ea5 2023-02-09 16:54:40,483 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1/a9a5e693d658482e9b378c99261c7ea5, entries=1, sequenceid=41, filesize=4.9 K 2023-02-09 16:54:40,484 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 30e984c82550d4e18563b5c25ccd6237 in 828ms, sequenceid=41, compaction requested=true 2023-02-09 16:54:40,484 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 30e984c82550d4e18563b5c25ccd6237: 2023-02-09 16:54:40,484 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1675961669674.30e984c82550d4e18563b5c25ccd6237. 2023-02-09 16:54:40,484 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 16:54:40,484 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 16:54:40,484 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:40,484 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-09 16:54:40,484 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-09 16:54:40,485 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:40,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:40,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:40,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:40,486 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:40,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:40,486 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:40,486 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:54:40,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:40,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:40,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:40,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:40,487 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-09 16:54:40,488 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@39ae0ce6[Count = 0] remaining members to acquire global barrier 2023-02-09 16:54:40,488 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-09 16:54:40,488 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:40,489 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:40,489 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:40,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:40,489 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-09 16:54:40,489 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-09 16:54:40,489 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:54:40,489 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:40,489 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:54:40,491 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-09 16:54:40,491 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:40,491 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:40,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:40,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:40,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:40,491 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-09 16:54:40,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:40,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:40,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:40,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:40,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:40,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:40,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:40,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:54:40,493 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-09 16:54:40,493 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-09 16:54:40,493 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:54:40,493 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:54:40,493 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:40,493 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:54:40,496 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:40,496 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:40,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:40,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:40,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:40,496 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:40,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:40,496 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:40,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:40,496 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:40,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:40,497 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:40,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:40,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:40,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:40,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:40,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:40,498 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:40,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:40,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:40,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:40,503 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:40,503 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:40,503 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:40,503 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-09 16:54:40,503 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-09 16:54:40,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:40,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:40,503 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:54:40,503 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:40,503 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:40,503 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:40,503 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:40,503 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:40,503 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:40,503 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:40,503 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 16:54:40,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:40,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:40,504 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:54:40,604 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:54:40,604 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:40,604 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:40,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:54:40,606 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41333] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyPolicy 2023-02-09 16:54:40,608 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] procedure2.ProcedureExecutor(1029): Stored pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-09 16:54:40,608 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-09 16:54:40,609 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 16:54:40,609 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=38, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675962280609 2023-02-09 16:54:40,610 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-09 16:54:40,612 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyPolicy' and column 'family1' 2023-02-09 16:54:40,612 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-09 16:54:40,612 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] zookeeper.ReadOnlyZKClient(139): Connect 0x65081758 to 127.0.0.1:53887 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 16:54:40,617 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@69fc7864, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 16:54:40,617 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-09 16:54:41,060 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103d04fb02399524e70b4c5a182b8048a2b to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103d04fb02399524e70b4c5a182b8048a2b 2023-02-09 16:54:41,061 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-09 16:54:41,073 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 16:54:41,074 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47890, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 16:54:41,079 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:41,080 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:41,080 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-09 16:54:41,081 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47864, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-09 16:54:41,089 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/531a76ab1af74c86ab953ec671e3eeed first=Optional[r3] last=Optional[r6] 2023-02-09 16:54:41,089 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1675961669674.30e984c82550d4e18563b5c25ccd6237., hostname=jenkins-hbase4.apache.org,35511,1675961620699, seqNum=2 for row with hfile group [{family1,hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/531a76ab1af74c86ab953ec671e3eeed}] 2023-02-09 16:54:41,093 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(763): Validating hfile at hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/531a76ab1af74c86ab953ec671e3eeed for inclusion in 30e984c82550d4e18563b5c25ccd6237/family1 2023-02-09 16:54:41,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-02-09 16:54:41,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(777): Region bounds: first= last= 2023-02-09 16:54:41,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HRegion(2445): Flush status journal for 30e984c82550d4e18563b5c25ccd6237: 2023-02-09 16:54:41,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/531a76ab1af74c86ab953ec671e3eeed to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionWithWeeklyPolicy__lvmsvu341ure4if25qgr26jgnqji5emnngrscses67in0htvm5upj8n8nlau3pgu/family1/531a76ab1af74c86ab953ec671e3eeed 2023-02-09 16:54:41,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionWithWeeklyPolicy__lvmsvu341ure4if25qgr26jgnqji5emnngrscses67in0htvm5upj8n8nlau3pgu/family1/531a76ab1af74c86ab953ec671e3eeed as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1/61191d8f2754456284377f61c1287d36_SeqId_44_ 2023-02-09 16:54:41,099 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(849): Loaded HFile hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionWithWeeklyPolicy__lvmsvu341ure4if25qgr26jgnqji5emnngrscses67in0htvm5upj8n8nlau3pgu/family1/531a76ab1af74c86ab953ec671e3eeed into 30e984c82550d4e18563b5c25ccd6237/family1 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1/61191d8f2754456284377f61c1287d36_SeqId_44_ - updating store file list. 2023-02-09 16:54:41,102 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(882): Loaded HFile hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1/61191d8f2754456284377f61c1287d36_SeqId_44_ into 30e984c82550d4e18563b5c25ccd6237/family1 2023-02-09 16:54:41,102 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(855): Successfully loaded hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionWithWeeklyPolicy__lvmsvu341ure4if25qgr26jgnqji5emnngrscses67in0htvm5upj8n8nlau3pgu/family1/531a76ab1af74c86ab953ec671e3eeed into 30e984c82550d4e18563b5c25ccd6237/family1 (new location: hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1/61191d8f2754456284377f61c1287d36_SeqId_44_) 2023-02-09 16:54:41,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionWithWeeklyPolicy__lvmsvu341ure4if25qgr26jgnqji5emnngrscses67in0htvm5upj8n8nlau3pgu/family1/531a76ab1af74c86ab953ec671e3eeed 2023-02-09 16:54:41,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-09 16:54:41,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-09 16:54:41,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(1912): 30e984c82550d4e18563b5c25ccd6237/family1 is initiating minor compaction 2023-02-09 16:54:41,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@19fd2d18; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 16:54:41,105 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 30e984c82550d4e18563b5c25ccd6237/family1 in testMajorCompactionWithWeeklyPolicy,,1675961669674.30e984c82550d4e18563b5c25ccd6237. 2023-02-09 16:54:41,105 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1/f9876ca6c2d643e59d364e1f2299241e, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1/692b76c234d34e42b538fd62b546dffe, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1/1284cab86682432d93d2dcb955dc6048, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1/927bbd2d566c4fb4913e0f04a0e57cd4, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1/87ac001defcc4339a52e673ef9250336, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1/d08fb67aabc749e09f862b5df575294b, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1/f0ec1f06fcca41b38a2dc59eb454a219, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1/73680fa9ee6448b69cab8d9d5944390d, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1/a9a5e693d658482e9b378c99261c7ea5, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1/61191d8f2754456284377f61c1287d36_SeqId_44_] into tmpdir=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/.tmp, totalSize=50.0 K 2023-02-09 16:54:41,105 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting f9876ca6c2d643e59d364e1f2299241e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-09 16:54:41,105 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting 692b76c234d34e42b538fd62b546dffe, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-09 16:54:41,105 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting 1284cab86682432d93d2dcb955dc6048, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-09 16:54:41,105 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting 927bbd2d566c4fb4913e0f04a0e57cd4, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-09 16:54:41,105 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting 87ac001defcc4339a52e673ef9250336, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-09 16:54:41,106 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting d08fb67aabc749e09f862b5df575294b, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-09 16:54:41,106 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting f0ec1f06fcca41b38a2dc59eb454a219, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-09 16:54:41,106 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting 73680fa9ee6448b69cab8d9d5944390d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-09 16:54:41,106 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting a9a5e693d658482e9b378c99261c7ea5, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-09 16:54:41,106 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting 61191d8f2754456284377f61c1287d36_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-09 16:54:41,107 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-09 16:54:41,108 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 16:54:41,109 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015122859aa51e102ec4cf19c1420f7416c80cb to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015122859aa51e102ec4cf19c1420f7416c80cb 2023-02-09 16:54:41,111 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231b5f72c600e3f4b9ea4aa09530f840483 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231b5f72c600e3f4b9ea4aa09530f840483 2023-02-09 16:54:41,112 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601014f512138ed084909ba6e7dc2fc87296c to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601014f512138ed084909ba6e7dc2fc87296c 2023-02-09 16:54:41,113 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103881aa4d6120c4cabb7d5a3cd8bca6a89 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103881aa4d6120c4cabb7d5a3cd8bca6a89 2023-02-09 16:54:41,113 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-02-09 16:54:41,113 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-02-09 16:54:41,114 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-09 16:54:41,114 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-09 16:54:41,114 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-09 16:54:41,114 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-09 16:54:41,114 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-09 16:54:41,114 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-09 16:54:41,114 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-09 16:54:41,114 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-09 16:54:41,139 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] throttle.PressureAwareThroughputController(145): 30e984c82550d4e18563b5c25ccd6237#family1#compaction#49 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 16:54:41,557 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/.tmp/family1/b43cb5279b664e80ab7318b582550514 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1/b43cb5279b664e80ab7318b582550514 2023-02-09 16:54:41,563 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 30e984c82550d4e18563b5c25ccd6237/family1 of 30e984c82550d4e18563b5c25ccd6237 into b43cb5279b664e80ab7318b582550514(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-09 16:54:41,563 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 30e984c82550d4e18563b5c25ccd6237: 2023-02-09 16:54:41,563 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1675961669674.30e984c82550d4e18563b5c25ccd6237., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1675961681105; duration=0sec 2023-02-09 16:54:41,563 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 16:54:41,654 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1/f9876ca6c2d643e59d364e1f2299241e, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1/692b76c234d34e42b538fd62b546dffe, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1/1284cab86682432d93d2dcb955dc6048, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1/927bbd2d566c4fb4913e0f04a0e57cd4, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1/87ac001defcc4339a52e673ef9250336, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1/d08fb67aabc749e09f862b5df575294b, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1/f0ec1f06fcca41b38a2dc59eb454a219, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1/73680fa9ee6448b69cab8d9d5944390d, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1/a9a5e693d658482e9b378c99261c7ea5, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1/61191d8f2754456284377f61c1287d36_SeqId_44_] to archive 2023-02-09 16:54:41,655 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 16:54:41,657 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1/f9876ca6c2d643e59d364e1f2299241e to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1/f9876ca6c2d643e59d364e1f2299241e 2023-02-09 16:54:41,659 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1/692b76c234d34e42b538fd62b546dffe to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1/692b76c234d34e42b538fd62b546dffe 2023-02-09 16:54:41,660 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1/1284cab86682432d93d2dcb955dc6048 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1/1284cab86682432d93d2dcb955dc6048 2023-02-09 16:54:41,662 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1/927bbd2d566c4fb4913e0f04a0e57cd4 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1/927bbd2d566c4fb4913e0f04a0e57cd4 2023-02-09 16:54:41,663 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1/87ac001defcc4339a52e673ef9250336 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1/87ac001defcc4339a52e673ef9250336 2023-02-09 16:54:41,664 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1/d08fb67aabc749e09f862b5df575294b to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1/d08fb67aabc749e09f862b5df575294b 2023-02-09 16:54:41,666 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1/f0ec1f06fcca41b38a2dc59eb454a219 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1/f0ec1f06fcca41b38a2dc59eb454a219 2023-02-09 16:54:41,667 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1/73680fa9ee6448b69cab8d9d5944390d to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1/73680fa9ee6448b69cab8d9d5944390d 2023-02-09 16:54:41,668 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1/a9a5e693d658482e9b378c99261c7ea5 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1/a9a5e693d658482e9b378c99261c7ea5 2023-02-09 16:54:41,669 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1/61191d8f2754456284377f61c1287d36_SeqId_44_ to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1/61191d8f2754456284377f61c1287d36_SeqId_44_ 2023-02-09 16:54:41,970 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120512023892715b479480102b89bb6a7f40 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015120512023892715b479480102b89bb6a7f40 2023-02-09 16:54:41,971 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-09 16:54:41,988 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:41,988 INFO [MobCompactor-pool-0] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:41,996 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/5359da05464241ed9b5223f8264b593b first=Optional[r00] last=Optional[r2] 2023-02-09 16:54:41,996 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1675961669674.30e984c82550d4e18563b5c25ccd6237., hostname=jenkins-hbase4.apache.org,35511,1675961620699, seqNum=2 for row with hfile group [{family1,hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/5359da05464241ed9b5223f8264b593b}] 2023-02-09 16:54:41,998 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(763): Validating hfile at hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/5359da05464241ed9b5223f8264b593b for inclusion in 30e984c82550d4e18563b5c25ccd6237/family1 2023-02-09 16:54:42,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-02-09 16:54:42,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(777): Region bounds: first= last= 2023-02-09 16:54:42,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HRegion(2445): Flush status journal for 30e984c82550d4e18563b5c25ccd6237: 2023-02-09 16:54:42,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/5359da05464241ed9b5223f8264b593b to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionWithWeeklyPolicy__s3at76tsrk8d3kc6cb6e0roq9s7mfb0tkeitc4gbrduf9doqhpm0otknc6veni14/family1/5359da05464241ed9b5223f8264b593b 2023-02-09 16:54:42,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionWithWeeklyPolicy__s3at76tsrk8d3kc6cb6e0roq9s7mfb0tkeitc4gbrduf9doqhpm0otknc6veni14/family1/5359da05464241ed9b5223f8264b593b as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1/74aa4633819e42afbb81dd840be1e6cc_SeqId_47_ 2023-02-09 16:54:42,005 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(849): Loaded HFile hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionWithWeeklyPolicy__s3at76tsrk8d3kc6cb6e0roq9s7mfb0tkeitc4gbrduf9doqhpm0otknc6veni14/family1/5359da05464241ed9b5223f8264b593b into 30e984c82550d4e18563b5c25ccd6237/family1 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1/74aa4633819e42afbb81dd840be1e6cc_SeqId_47_ - updating store file list. 2023-02-09 16:54:42,009 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(882): Loaded HFile hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1/74aa4633819e42afbb81dd840be1e6cc_SeqId_47_ into 30e984c82550d4e18563b5c25ccd6237/family1 2023-02-09 16:54:42,009 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(855): Successfully loaded hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionWithWeeklyPolicy__s3at76tsrk8d3kc6cb6e0roq9s7mfb0tkeitc4gbrduf9doqhpm0otknc6veni14/family1/5359da05464241ed9b5223f8264b593b into 30e984c82550d4e18563b5c25ccd6237/family1 (new location: hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1/74aa4633819e42afbb81dd840be1e6cc_SeqId_47_) 2023-02-09 16:54:42,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionWithWeeklyPolicy__s3at76tsrk8d3kc6cb6e0roq9s7mfb0tkeitc4gbrduf9doqhpm0otknc6veni14/family1/5359da05464241ed9b5223f8264b593b 2023-02-09 16:54:42,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-09 16:54:42,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 345120 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-09 16:54:42,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(1912): 30e984c82550d4e18563b5c25ccd6237/family1 is initiating minor compaction (all files) 2023-02-09 16:54:42,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@3ad6ab1a; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 16:54:42,011 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 30e984c82550d4e18563b5c25ccd6237/family1 in testMajorCompactionWithWeeklyPolicy,,1675961669674.30e984c82550d4e18563b5c25ccd6237. 2023-02-09 16:54:42,011 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1/2846f721918d4cb9897abbf15303f185, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1/b43cb5279b664e80ab7318b582550514, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1/74aa4633819e42afbb81dd840be1e6cc_SeqId_47_] into tmpdir=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/.tmp, totalSize=337.0 K 2023-02-09 16:54:42,011 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting 2846f721918d4cb9897abbf15303f185, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878845085 2023-02-09 16:54:42,012 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting b43cb5279b664e80ab7318b582550514, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621245085 2023-02-09 16:54:42,012 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting 74aa4633819e42afbb81dd840be1e6cc_SeqId_47_, keycount=1002, bloomtype=ROW, size=165.4 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878845085 2023-02-09 16:54:42,012 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-09 16:54:42,013 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 16:54:42,015 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130073ed035f1a64d82a7c52b25861ced5a to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130073ed035f1a64d82a7c52b25861ced5a 2023-02-09 16:54:42,016 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201e390baa3b3dd40d39bcde1905d4f8fdd to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201e390baa3b3dd40d39bcde1905d4f8fdd 2023-02-09 16:54:42,017 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205980821c684af4f58a0e47520e9b7b172 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205980821c684af4f58a0e47520e9b7b172 2023-02-09 16:54:42,017 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 3 expired mob files are deleted 2023-02-09 16:54:42,017 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-02-09 16:54:42,017 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-09 16:54:42,017 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-09 16:54:42,017 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 16:54:42,018 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=38, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-09 16:54:42,020 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=38, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.4110 sec 2023-02-09 16:54:42,026 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] throttle.PressureAwareThroughputController(145): 30e984c82550d4e18563b5c25ccd6237#family1#compaction#50 average throughput is 25.77 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 16:54:42,107 INFO [Listener at localhost/41619] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=255 (was 248) - Thread LEAK? -, OpenFileDescriptor=615 (was 586) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=177 (was 197), ProcessCount=168 (was 168), AvailableMemoryMB=3114 (was 3186) 2023-02-09 16:54:42,118 INFO [Listener at localhost/41619] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=255, OpenFileDescriptor=615, MaxFileDescriptor=60000, SystemLoadAverage=177, ProcessCount=168, AvailableMemoryMB=3113 2023-02-09 16:54:42,119 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:42,119 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:42,121 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-09 16:54:42,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure2.ProcedureExecutor(1029): Stored pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:42,123 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 16:54:42,123 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly" procId is: 39 2023-02-09 16:54:42,124 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:42,124 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:42,124 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 16:54:42,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-09 16:54:42,125 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242 2023-02-09 16:54:42,126 DEBUG [HFileArchiver-9] backup.HFileArchiver(153): Directory hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242 empty. 2023-02-09 16:54:42,127 DEBUG [HFileArchiver-9] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242 2023-02-09 16:54:42,127 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly regions 2023-02-09 16:54:42,225 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:42,225 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:42,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-09 16:54:42,237 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-02-09 16:54:42,426 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:42,426 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:42,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-09 16:54:42,535 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-02-09 16:54:42,536 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(7671): creating {ENCODED => e4f991fcac5fe84bc0d9e3454023c242, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp 2023-02-09 16:54:42,727 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:42,727 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:42,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-09 16:54:42,942 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 16:54:42,942 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1603): Closing e4f991fcac5fe84bc0d9e3454023c242, disabling compactions & flushes 2023-02-09 16:54:42,942 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242. 2023-02-09 16:54:42,942 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242. 2023-02-09 16:54:42,942 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242. after waiting 0 ms 2023-02-09 16:54:42,942 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242. 2023-02-09 16:54:42,942 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242. 2023-02-09 16:54:42,942 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1557): Region close journal for e4f991fcac5fe84bc0d9e3454023c242: Waiting for close lock at 1675961682942Disabling compacts and flushes for region at 1675961682942Disabling writes for close at 1675961682942Writing region close event to WAL at 1675961682942Closed at 1675961682942 2023-02-09 16:54:42,944 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 16:54:42,945 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1675961682945"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675961682945"}]},"ts":"1675961682945"} 2023-02-09 16:54:42,947 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-09 16:54:42,947 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 16:54:42,948 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675961682948"}]},"ts":"1675961682948"} 2023-02-09 16:54:42,949 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLING in hbase:meta 2023-02-09 16:54:42,951 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=e4f991fcac5fe84bc0d9e3454023c242, ASSIGN}] 2023-02-09 16:54:42,953 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=e4f991fcac5fe84bc0d9e3454023c242, ASSIGN 2023-02-09 16:54:42,953 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=e4f991fcac5fe84bc0d9e3454023c242, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35511,1675961620699; forceNewPlan=false, retain=false 2023-02-09 16:54:43,104 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=e4f991fcac5fe84bc0d9e3454023c242, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:43,105 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1675961683104"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675961683104"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675961683104"}]},"ts":"1675961683104"} 2023-02-09 16:54:43,106 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=41, ppid=40, state=RUNNABLE; OpenRegionProcedure e4f991fcac5fe84bc0d9e3454023c242, server=jenkins-hbase4.apache.org,35511,1675961620699}] 2023-02-09 16:54:43,228 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:43,228 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:43,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-09 16:54:43,243 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/.tmp/family1/0174795264ff41359cb39ddeb66b0fb8 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1/0174795264ff41359cb39ddeb66b0fb8 2023-02-09 16:54:43,248 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 30e984c82550d4e18563b5c25ccd6237/family1 of 30e984c82550d4e18563b5c25ccd6237 into 0174795264ff41359cb39ddeb66b0fb8(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-09 16:54:43,248 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 30e984c82550d4e18563b5c25ccd6237: 2023-02-09 16:54:43,248 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1675961669674.30e984c82550d4e18563b5c25ccd6237., storeName=family1, fileCount=3, fileSize=337.0 K (165.1 K, 6.6 K, 165.4 K), priority=2, time=1675961682011; duration=1sec 2023-02-09 16:54:43,248 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 16:54:43,254 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1/2846f721918d4cb9897abbf15303f185, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1/b43cb5279b664e80ab7318b582550514, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1/74aa4633819e42afbb81dd840be1e6cc_SeqId_47_] to archive 2023-02-09 16:54:43,255 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 16:54:43,257 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1/2846f721918d4cb9897abbf15303f185 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1/2846f721918d4cb9897abbf15303f185 2023-02-09 16:54:43,258 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1/b43cb5279b664e80ab7318b582550514 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1/b43cb5279b664e80ab7318b582550514 2023-02-09 16:54:43,259 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1/74aa4633819e42afbb81dd840be1e6cc_SeqId_47_ to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/family1/74aa4633819e42afbb81dd840be1e6cc_SeqId_47_ 2023-02-09 16:54:43,261 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242. 2023-02-09 16:54:43,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e4f991fcac5fe84bc0d9e3454023c242, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242.', STARTKEY => '', ENDKEY => ''} 2023-02-09 16:54:43,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly e4f991fcac5fe84bc0d9e3454023c242 2023-02-09 16:54:43,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 16:54:43,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for e4f991fcac5fe84bc0d9e3454023c242 2023-02-09 16:54:43,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for e4f991fcac5fe84bc0d9e3454023c242 2023-02-09 16:54:43,262 INFO [StoreOpener-e4f991fcac5fe84bc0d9e3454023c242-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region e4f991fcac5fe84bc0d9e3454023c242 2023-02-09 16:54:43,263 DEBUG [StoreOpener-e4f991fcac5fe84bc0d9e3454023c242-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1 2023-02-09 16:54:43,263 DEBUG [StoreOpener-e4f991fcac5fe84bc0d9e3454023c242-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1 2023-02-09 16:54:43,264 INFO [StoreOpener-e4f991fcac5fe84bc0d9e3454023c242-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e4f991fcac5fe84bc0d9e3454023c242 columnFamilyName family1 2023-02-09 16:54:43,265 INFO [StoreOpener-e4f991fcac5fe84bc0d9e3454023c242-1] regionserver.HStore(310): Store=e4f991fcac5fe84bc0d9e3454023c242/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 16:54:43,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242 2023-02-09 16:54:43,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242 2023-02-09 16:54:43,268 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for e4f991fcac5fe84bc0d9e3454023c242 2023-02-09 16:54:43,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 16:54:43,270 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened e4f991fcac5fe84bc0d9e3454023c242; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73556523, jitterRate=0.09607760608196259}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 16:54:43,270 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for e4f991fcac5fe84bc0d9e3454023c242: Running coprocessor pre-open hook at 1675961683261Writing region info on filesystem at 1675961683261Initializing all the Stores at 1675961683262 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1675961683262Cleaning up temporary data from old regions at 1675961683266 (+4 ms)Cleaning up detritus from prior splits at 1675961683266Running coprocessor post-open hooks at 1675961683270 (+4 ms)Region opened successfully at 1675961683270 2023-02-09 16:54:43,270 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242., pid=41, masterSystemTime=1675961683258 2023-02-09 16:54:43,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242. 2023-02-09 16:54:43,272 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242. 2023-02-09 16:54:43,272 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=e4f991fcac5fe84bc0d9e3454023c242, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:43,273 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1675961683272"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675961683272"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675961683272"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675961683272"}]},"ts":"1675961683272"} 2023-02-09 16:54:43,275 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=41, resume processing ppid=40 2023-02-09 16:54:43,275 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=40, state=SUCCESS; OpenRegionProcedure e4f991fcac5fe84bc0d9e3454023c242, server=jenkins-hbase4.apache.org,35511,1675961620699 in 168 msec 2023-02-09 16:54:43,276 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=39 2023-02-09 16:54:43,276 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=e4f991fcac5fe84bc0d9e3454023c242, ASSIGN in 324 msec 2023-02-09 16:54:43,277 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 16:54:43,277 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675961683277"}]},"ts":"1675961683277"} 2023-02-09 16:54:43,278 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLED in hbase:meta 2023-02-09 16:54:43,280 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 16:54:43,281 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=39, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.1590 sec 2023-02-09 16:54:44,229 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:44,229 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:44,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-09 16:54:44,230 INFO [Listener at localhost/41619] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, procId: 39 completed 2023-02-09 16:54:44,249 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:44,249 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:44,250 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:54:44,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:44,252 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-09 16:54:44,252 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:44,252 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-09 16:54:44,252 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-09 16:54:44,252 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:44,252 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:44,254 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:44,254 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:44,254 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:44,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:44,254 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:44,254 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:54:44,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:44,254 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:44,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:54:44,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:44,255 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:44,255 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:44,255 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-09 16:54:44,255 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:44,255 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-09 16:54:44,255 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 16:54:44,255 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:54:44,255 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242. 2023-02-09 16:54:44,255 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242. started... 2023-02-09 16:54:44,256 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e4f991fcac5fe84bc0d9e3454023c242 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-09 16:54:44,674 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511308730ff1d4d354bc6a4effd3dd6c2fde5 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511308730ff1d4d354bc6a4effd3dd6c2fde5 2023-02-09 16:54:45,078 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/.tmp/family1/2450f3f14fb040309bf336675c42a287 2023-02-09 16:54:45,083 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/.tmp/family1/2450f3f14fb040309bf336675c42a287 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/2450f3f14fb040309bf336675c42a287 2023-02-09 16:54:45,087 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/2450f3f14fb040309bf336675c42a287, entries=1000, sequenceid=5, filesize=191.4 K 2023-02-09 16:54:45,088 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for e4f991fcac5fe84bc0d9e3454023c242 in 832ms, sequenceid=5, compaction requested=false 2023-02-09 16:54:45,088 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-09 16:54:45,089 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e4f991fcac5fe84bc0d9e3454023c242: 2023-02-09 16:54:45,089 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242. 2023-02-09 16:54:45,089 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 16:54:45,089 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 16:54:45,089 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:45,089 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-09 16:54:45,089 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-09 16:54:45,091 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:45,091 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:45,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:45,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:45,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:45,091 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:45,091 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:54:45,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:45,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:45,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:45,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:45,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:45,092 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-09 16:54:45,092 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@29995220[Count = 0] remaining members to acquire global barrier 2023-02-09 16:54:45,092 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-09 16:54:45,092 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:45,094 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:45,094 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:45,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:45,094 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-09 16:54:45,094 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-09 16:54:45,094 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:45,094 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:54:45,094 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:54:45,101 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-09 16:54:45,101 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:45,101 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:45,102 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-09 16:54:45,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:45,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:45,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:45,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:45,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:45,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:45,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:45,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:45,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:45,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:45,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:54:45,104 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-09 16:54:45,104 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-09 16:54:45,104 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:54:45,104 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:54:45,104 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:45,104 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:54:45,105 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:45,105 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:45,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:45,105 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:45,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:45,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:45,105 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:45,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:45,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:45,106 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:45,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:45,106 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:45,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:45,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:45,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:45,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:45,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:45,107 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:45,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:45,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:45,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:45,109 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:45,109 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:45,109 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:45,109 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:45,109 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:45,109 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-09 16:54:45,109 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-09 16:54:45,109 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:54:45,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:45,109 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:45,109 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:45,110 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:45,110 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:45,110 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:45,110 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:45,110 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-09 16:54:45,110 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:54:45,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:45,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:45,210 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:54:45,210 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:45,210 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:45,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:54:45,214 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:45,214 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:45,215 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:54:45,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-09 16:54:45,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:45,216 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-09 16:54:45,216 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:45,216 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-09 16:54:45,216 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-09 16:54:45,217 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:45,217 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:45,218 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:45,218 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:45,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:45,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:45,218 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:45,218 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:54:45,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:45,219 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:45,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:54:45,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:45,219 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:45,219 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-09 16:54:45,219 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:45,219 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-09 16:54:45,219 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:45,219 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-09 16:54:45,219 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 16:54:45,219 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:54:45,220 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242. 2023-02-09 16:54:45,220 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242. started... 2023-02-09 16:54:45,220 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e4f991fcac5fe84bc0d9e3454023c242 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-09 16:54:45,631 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511285bebc0004bac4d58819acb0b54156650 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511285bebc0004bac4d58819acb0b54156650 2023-02-09 16:54:46,037 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/.tmp/family1/326205c3c37f4fb592256270d10f05db 2023-02-09 16:54:46,042 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/.tmp/family1/326205c3c37f4fb592256270d10f05db as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/326205c3c37f4fb592256270d10f05db 2023-02-09 16:54:46,046 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/326205c3c37f4fb592256270d10f05db, entries=1, sequenceid=9, filesize=5.0 K 2023-02-09 16:54:46,047 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for e4f991fcac5fe84bc0d9e3454023c242 in 827ms, sequenceid=9, compaction requested=false 2023-02-09 16:54:46,047 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e4f991fcac5fe84bc0d9e3454023c242: 2023-02-09 16:54:46,047 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242. 2023-02-09 16:54:46,047 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 16:54:46,047 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 16:54:46,047 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:46,047 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-09 16:54:46,047 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-09 16:54:46,081 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:46,081 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:46,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:46,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:46,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:46,082 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:46,082 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:54:46,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:46,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:46,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:46,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:46,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:46,083 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-09 16:54:46,083 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5c5cedb7[Count = 0] remaining members to acquire global barrier 2023-02-09 16:54:46,083 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-09 16:54:46,083 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:46,089 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:46,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:46,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:46,089 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-09 16:54:46,089 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-09 16:54:46,089 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:54:46,089 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:46,089 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:54:46,096 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:46,096 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-09 16:54:46,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:46,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:46,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:46,097 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:46,097 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-09 16:54:46,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:46,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:46,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:46,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:46,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:46,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:46,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:46,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:54:46,099 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-09 16:54:46,099 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-09 16:54:46,099 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:54:46,099 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:54:46,099 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:46,099 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:54:46,105 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:46,105 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:46,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:46,106 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:46,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:46,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:46,105 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:46,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:46,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:46,106 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:46,106 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:46,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:46,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:46,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:46,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:46,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:46,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:46,107 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:46,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:46,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:46,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:46,118 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:46,118 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:46,118 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:46,118 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:46,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:46,118 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:46,118 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-09 16:54:46,118 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:54:46,118 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:46,118 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:46,119 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:46,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:46,119 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:46,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:46,119 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-09 16:54:46,119 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:46,119 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:54:46,119 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:46,219 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:54:46,219 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:46,219 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:46,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:54:46,223 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:46,223 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:46,224 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:54:46,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-09 16:54:46,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:46,225 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-09 16:54:46,225 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:46,225 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-09 16:54:46,225 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-09 16:54:46,226 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:46,226 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:46,227 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:46,227 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:46,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:46,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:46,227 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:46,227 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:54:46,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:46,228 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:46,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:54:46,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:46,228 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:46,228 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-09 16:54:46,228 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:46,228 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-09 16:54:46,228 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:46,229 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-09 16:54:46,229 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 16:54:46,229 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:54:46,229 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242. 2023-02-09 16:54:46,229 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242. started... 2023-02-09 16:54:46,229 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e4f991fcac5fe84bc0d9e3454023c242 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 16:54:46,641 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201271d8a4500694aca96e7de1d6e77d535 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201271d8a4500694aca96e7de1d6e77d535 2023-02-09 16:54:47,046 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/.tmp/family1/95c9b043da96472a8ab503a6e6cb6116 2023-02-09 16:54:47,051 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/.tmp/family1/95c9b043da96472a8ab503a6e6cb6116 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/95c9b043da96472a8ab503a6e6cb6116 2023-02-09 16:54:47,055 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/95c9b043da96472a8ab503a6e6cb6116, entries=1, sequenceid=13, filesize=5.0 K 2023-02-09 16:54:47,056 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e4f991fcac5fe84bc0d9e3454023c242 in 827ms, sequenceid=13, compaction requested=true 2023-02-09 16:54:47,056 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e4f991fcac5fe84bc0d9e3454023c242: 2023-02-09 16:54:47,056 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242. 2023-02-09 16:54:47,056 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 16:54:47,056 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 16:54:47,056 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:47,056 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-09 16:54:47,056 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-09 16:54:47,059 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:47,059 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:47,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:47,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:47,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:47,059 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:47,059 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:54:47,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:47,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:47,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:47,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:47,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:47,061 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-09 16:54:47,061 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5a2daa52[Count = 0] remaining members to acquire global barrier 2023-02-09 16:54:47,061 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-09 16:54:47,061 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:47,062 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:47,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:47,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:47,062 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-09 16:54:47,062 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-09 16:54:47,062 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:54:47,062 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:47,063 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:54:47,064 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-09 16:54:47,064 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:47,064 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:47,064 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-09 16:54:47,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:47,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:47,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:47,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:47,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:47,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:47,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:47,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:47,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:47,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:47,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:54:47,066 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-09 16:54:47,066 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-09 16:54:47,066 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:54:47,066 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:54:47,066 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:47,066 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:54:47,068 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:47,068 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:47,068 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:47,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:47,068 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:47,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:47,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:47,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:47,068 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:47,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:47,069 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:47,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:47,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:47,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:47,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:47,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:47,070 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:47,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:47,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:47,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:47,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:47,074 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:47,074 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:47,074 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:47,074 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:47,074 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:47,074 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-09 16:54:47,074 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:47,074 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:47,074 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:47,075 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:47,074 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:47,074 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:54:47,075 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-09 16:54:47,074 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:47,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:47,075 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-09 16:54:47,075 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:54:47,075 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:47,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:47,175 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:54:47,175 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:47,175 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:47,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:54:47,179 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:47,179 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:47,180 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:54:47,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-09 16:54:47,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:47,182 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-09 16:54:47,182 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:47,182 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-09 16:54:47,182 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-09 16:54:47,182 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:47,182 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:47,183 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:47,183 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:47,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:47,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:47,184 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:47,184 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:54:47,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:47,184 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:47,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:54:47,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:47,184 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:47,185 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-09 16:54:47,185 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:47,185 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-09 16:54:47,185 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:47,185 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-09 16:54:47,185 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 16:54:47,185 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:54:47,185 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242. 2023-02-09 16:54:47,185 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242. started... 2023-02-09 16:54:47,185 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e4f991fcac5fe84bc0d9e3454023c242 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 16:54:47,597 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205a11dc5ffcc2d4e0ea8ba0e7bac977789 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205a11dc5ffcc2d4e0ea8ba0e7bac977789 2023-02-09 16:54:48,002 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/.tmp/family1/6fe3421ba2ed42d990547d4f1cabd725 2023-02-09 16:54:48,007 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/.tmp/family1/6fe3421ba2ed42d990547d4f1cabd725 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/6fe3421ba2ed42d990547d4f1cabd725 2023-02-09 16:54:48,011 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/6fe3421ba2ed42d990547d4f1cabd725, entries=1, sequenceid=17, filesize=5.0 K 2023-02-09 16:54:48,012 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e4f991fcac5fe84bc0d9e3454023c242 in 827ms, sequenceid=17, compaction requested=true 2023-02-09 16:54:48,012 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e4f991fcac5fe84bc0d9e3454023c242: 2023-02-09 16:54:48,012 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242. 2023-02-09 16:54:48,012 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 16:54:48,012 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 16:54:48,012 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:48,012 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-09 16:54:48,012 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-09 16:54:48,014 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:48,014 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:48,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:48,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:48,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:48,014 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:48,014 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:54:48,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:48,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:48,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:48,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:48,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:48,016 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-09 16:54:48,016 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@132d44cd[Count = 0] remaining members to acquire global barrier 2023-02-09 16:54:48,016 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-09 16:54:48,016 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:48,018 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:48,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:48,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:48,018 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-09 16:54:48,018 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-09 16:54:48,018 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:54:48,019 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:48,019 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:54:48,020 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:48,020 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-09 16:54:48,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:48,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:48,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:48,020 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:48,020 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-09 16:54:48,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:48,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:48,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:48,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:48,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:48,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:48,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:48,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:54:48,022 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-09 16:54:48,022 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-09 16:54:48,022 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:54:48,022 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:54:48,022 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:48,022 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:54:48,023 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:48,023 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:48,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:48,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:48,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:48,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:48,023 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:48,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:48,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:48,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:48,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:48,024 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:48,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:48,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:48,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:48,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:48,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:48,025 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:48,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:48,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:48,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:48,027 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:48,027 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:48,027 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:48,027 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-09 16:54:48,027 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:48,027 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:54:48,027 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:48,027 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:48,027 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:48,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:48,027 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:48,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:48,027 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:48,027 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-09 16:54:48,028 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:54:48,027 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:48,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:48,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:48,128 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:54:48,128 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:48,128 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:48,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:54:48,132 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:48,132 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:48,132 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:54:48,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-09 16:54:48,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:48,134 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-09 16:54:48,134 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:48,134 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-09 16:54:48,134 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-09 16:54:48,135 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:48,135 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:48,137 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:48,137 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:48,137 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:48,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:48,137 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:48,137 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:54:48,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:48,137 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:48,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:54:48,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:48,138 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:48,138 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-09 16:54:48,138 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:48,138 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-09 16:54:48,138 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:48,138 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-09 16:54:48,138 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 16:54:48,138 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:54:48,138 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242. 2023-02-09 16:54:48,138 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242. started... 2023-02-09 16:54:48,139 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e4f991fcac5fe84bc0d9e3454023c242 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 16:54:48,550 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512284653a631f86c42eea051e93ca4cdfe92 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512284653a631f86c42eea051e93ca4cdfe92 2023-02-09 16:54:48,804 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-09 16:54:48,955 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/.tmp/family1/49337f3359d244ae9a15ab5fa3386947 2023-02-09 16:54:48,960 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/.tmp/family1/49337f3359d244ae9a15ab5fa3386947 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/49337f3359d244ae9a15ab5fa3386947 2023-02-09 16:54:48,964 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/49337f3359d244ae9a15ab5fa3386947, entries=1, sequenceid=21, filesize=5.0 K 2023-02-09 16:54:48,965 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e4f991fcac5fe84bc0d9e3454023c242 in 827ms, sequenceid=21, compaction requested=true 2023-02-09 16:54:48,965 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e4f991fcac5fe84bc0d9e3454023c242: 2023-02-09 16:54:48,965 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242. 2023-02-09 16:54:48,965 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 16:54:48,965 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 16:54:48,965 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:48,965 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-09 16:54:48,965 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-09 16:54:48,969 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:48,969 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:48,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:48,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:48,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:48,969 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:48,969 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:54:48,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:48,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:48,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:48,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:48,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:48,970 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-09 16:54:48,970 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@70461cda[Count = 0] remaining members to acquire global barrier 2023-02-09 16:54:48,970 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-09 16:54:48,970 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:48,971 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:48,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:48,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:48,972 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-09 16:54:48,972 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-09 16:54:48,972 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:54:48,972 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:48,972 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:54:48,974 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:48,974 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-09 16:54:48,974 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:48,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:48,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:48,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:48,974 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-09 16:54:48,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:48,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:48,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:48,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:48,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:48,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:48,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:48,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:54:48,976 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-09 16:54:48,976 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-09 16:54:48,976 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:54:48,976 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:54:48,976 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:48,976 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:54:48,977 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:48,977 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:48,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:48,978 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:48,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:48,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:48,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:48,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:48,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:48,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:48,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:48,978 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:48,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:48,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:48,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:48,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:48,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:48,979 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:48,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:48,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:48,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:48,981 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:48,981 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:48,981 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:48,981 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:48,981 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:48,982 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-09 16:54:48,982 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:54:48,981 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:48,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:48,982 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-09 16:54:48,982 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:48,982 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:48,982 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:48,982 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-09 16:54:48,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:48,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:48,982 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:48,982 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:54:48,982 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:49,082 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:54:49,082 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:49,083 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:49,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:54:49,086 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:49,086 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:49,087 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:54:49,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-09 16:54:49,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:49,089 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-09 16:54:49,089 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:49,089 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-09 16:54:49,089 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-09 16:54:49,089 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:49,089 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:49,091 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:49,091 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:49,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:49,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:49,091 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:49,091 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:54:49,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:49,091 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:49,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:54:49,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:49,092 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:49,092 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-09 16:54:49,092 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:49,092 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-09 16:54:49,092 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:49,092 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-09 16:54:49,092 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 16:54:49,092 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:54:49,092 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242. 2023-02-09 16:54:49,092 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242. started... 2023-02-09 16:54:49,092 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e4f991fcac5fe84bc0d9e3454023c242 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 16:54:49,505 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231ff11549d7ebc4b878eac73bd6dac30a3 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231ff11549d7ebc4b878eac73bd6dac30a3 2023-02-09 16:54:49,910 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/.tmp/family1/215fa59704d9498fb6960a74eb1e7833 2023-02-09 16:54:49,915 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/.tmp/family1/215fa59704d9498fb6960a74eb1e7833 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/215fa59704d9498fb6960a74eb1e7833 2023-02-09 16:54:49,918 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/215fa59704d9498fb6960a74eb1e7833, entries=1, sequenceid=25, filesize=5.0 K 2023-02-09 16:54:49,919 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e4f991fcac5fe84bc0d9e3454023c242 in 827ms, sequenceid=25, compaction requested=true 2023-02-09 16:54:49,919 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e4f991fcac5fe84bc0d9e3454023c242: 2023-02-09 16:54:49,919 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242. 2023-02-09 16:54:49,919 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 16:54:49,919 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 16:54:49,919 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:49,919 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-09 16:54:49,919 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-09 16:54:49,922 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:49,922 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:49,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:49,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:49,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:49,922 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:49,922 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:54:49,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:49,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:49,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:49,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:49,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:49,923 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-09 16:54:49,924 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4bcc7630[Count = 0] remaining members to acquire global barrier 2023-02-09 16:54:49,924 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-09 16:54:49,924 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:49,925 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:49,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:49,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:49,925 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-09 16:54:49,925 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-09 16:54:49,925 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:54:49,925 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:49,925 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:54:49,926 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-09 16:54:49,926 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:49,926 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:49,926 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-09 16:54:49,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:49,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:49,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:49,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:49,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:49,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:49,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:49,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:49,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:49,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:49,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:54:49,928 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-09 16:54:49,928 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-09 16:54:49,928 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:54:49,928 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:54:49,928 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:49,928 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:54:49,929 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:49,929 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:49,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:49,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:49,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:49,930 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:49,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:49,930 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:49,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:49,930 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:49,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:49,930 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:49,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:49,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:49,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:49,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:49,931 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:49,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:49,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:49,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:49,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:49,935 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:49,935 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:49,935 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:49,935 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:49,935 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:49,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:49,935 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:49,935 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-09 16:54:49,935 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:54:49,935 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:49,935 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-09 16:54:49,935 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:49,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:49,935 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:49,935 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:49,935 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-09 16:54:49,935 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:54:49,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:49,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:50,035 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:54:50,036 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:50,036 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:50,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:54:50,040 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:50,040 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:50,041 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:54:50,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-09 16:54:50,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:50,043 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-09 16:54:50,043 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:50,043 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-09 16:54:50,043 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-09 16:54:50,043 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:50,043 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:50,044 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:50,044 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:50,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:50,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:50,045 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:50,045 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:54:50,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:50,045 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:50,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:54:50,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:50,046 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:50,046 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-09 16:54:50,046 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:50,046 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-09 16:54:50,046 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:50,046 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-09 16:54:50,046 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 16:54:50,046 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:54:50,046 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242. 2023-02-09 16:54:50,046 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242. started... 2023-02-09 16:54:50,046 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e4f991fcac5fe84bc0d9e3454023c242 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 16:54:50,062 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010159833b89b2464789bb626cf2757fef2d to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2016010159833b89b2464789bb626cf2757fef2d 2023-02-09 16:54:50,468 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/.tmp/family1/f008d5ca8be5415bb3e7f7c3b176ecd7 2023-02-09 16:54:50,472 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/.tmp/family1/f008d5ca8be5415bb3e7f7c3b176ecd7 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/f008d5ca8be5415bb3e7f7c3b176ecd7 2023-02-09 16:54:50,477 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/f008d5ca8be5415bb3e7f7c3b176ecd7, entries=1, sequenceid=29, filesize=5.0 K 2023-02-09 16:54:50,478 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e4f991fcac5fe84bc0d9e3454023c242 in 432ms, sequenceid=29, compaction requested=true 2023-02-09 16:54:50,478 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e4f991fcac5fe84bc0d9e3454023c242: 2023-02-09 16:54:50,478 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242. 2023-02-09 16:54:50,478 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 16:54:50,478 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 16:54:50,478 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:50,478 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-09 16:54:50,478 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-09 16:54:50,480 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:50,480 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:50,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:50,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:50,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:50,480 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:50,480 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:54:50,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:50,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:50,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:50,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:50,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:50,482 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-09 16:54:50,482 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7c042a21[Count = 0] remaining members to acquire global barrier 2023-02-09 16:54:50,482 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-09 16:54:50,482 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:50,483 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:50,483 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:50,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:50,483 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-09 16:54:50,484 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-09 16:54:50,484 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:50,484 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:54:50,484 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:54:50,486 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-09 16:54:50,486 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:50,486 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:50,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:50,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:50,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:50,486 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-09 16:54:50,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:50,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:50,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:50,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:50,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:50,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:50,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:50,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:54:50,489 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-09 16:54:50,489 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-09 16:54:50,489 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:54:50,489 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:54:50,489 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:50,489 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:54:50,496 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:50,496 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:50,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:50,496 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:50,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:50,496 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:50,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:50,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:50,496 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:50,496 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:50,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:50,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:50,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:50,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:50,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:50,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:50,498 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:50,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:50,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:50,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:50,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:50,500 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:50,500 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:50,500 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:50,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:50,500 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:50,500 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-09 16:54:50,500 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:54:50,500 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:50,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:50,500 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-09 16:54:50,500 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:50,500 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:50,500 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-09 16:54:50,500 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:54:50,500 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:50,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:50,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:50,500 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:50,501 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:50,601 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:54:50,601 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:50,601 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:50,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:54:50,605 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:50,605 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:50,605 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:54:50,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-09 16:54:50,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:50,607 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-09 16:54:50,607 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:50,607 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-09 16:54:50,607 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-09 16:54:50,608 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:50,608 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:50,610 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:50,610 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:50,610 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:50,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:50,610 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:50,610 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:54:50,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:50,611 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:50,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:54:50,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:50,611 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:50,611 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-09 16:54:50,611 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:50,611 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-09 16:54:50,612 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:50,612 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-09 16:54:50,612 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 16:54:50,612 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:54:50,612 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242. 2023-02-09 16:54:50,612 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242. started... 2023-02-09 16:54:50,612 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e4f991fcac5fe84bc0d9e3454023c242 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 16:54:51,023 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103a39577825b834e1982aacd60aafd07a4 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103a39577825b834e1982aacd60aafd07a4 2023-02-09 16:54:51,429 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/.tmp/family1/15086a867aeb49edbb37cd7fa108846a 2023-02-09 16:54:51,433 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/.tmp/family1/15086a867aeb49edbb37cd7fa108846a as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/15086a867aeb49edbb37cd7fa108846a 2023-02-09 16:54:51,437 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/15086a867aeb49edbb37cd7fa108846a, entries=1, sequenceid=33, filesize=5.0 K 2023-02-09 16:54:51,438 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e4f991fcac5fe84bc0d9e3454023c242 in 826ms, sequenceid=33, compaction requested=true 2023-02-09 16:54:51,438 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e4f991fcac5fe84bc0d9e3454023c242: 2023-02-09 16:54:51,438 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242. 2023-02-09 16:54:51,438 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 16:54:51,438 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 16:54:51,438 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:51,438 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-09 16:54:51,438 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-09 16:54:51,439 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:51,439 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:51,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:51,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:51,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:51,440 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:51,440 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:54:51,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:51,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:51,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:51,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:51,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:51,441 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-09 16:54:51,441 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5760240[Count = 0] remaining members to acquire global barrier 2023-02-09 16:54:51,441 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-09 16:54:51,441 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:51,442 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:51,442 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:51,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:51,442 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-09 16:54:51,442 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-09 16:54:51,442 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:54:51,442 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:51,442 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:54:51,444 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-09 16:54:51,444 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:51,444 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:51,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:51,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:51,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:51,444 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-09 16:54:51,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:51,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:51,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:51,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:51,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:51,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:51,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:51,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:54:51,447 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-09 16:54:51,447 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-09 16:54:51,447 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:54:51,447 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:54:51,447 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:51,447 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:54:51,448 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:51,448 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:51,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:51,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:51,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:51,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:51,448 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:51,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:51,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:51,449 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:51,449 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:51,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:51,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:51,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:51,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:51,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:51,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:51,450 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:51,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:51,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:51,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:51,452 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:51,452 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:51,452 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:51,452 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:51,452 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:51,452 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:51,452 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:51,452 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-09 16:54:51,452 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-09 16:54:51,452 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:51,452 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:54:51,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:51,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:51,452 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:51,452 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:51,453 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-09 16:54:51,453 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:54:51,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:51,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:51,553 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:54:51,553 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:51,553 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:51,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:54:51,557 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:51,557 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:51,558 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:54:51,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-09 16:54:51,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:51,559 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-09 16:54:51,559 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:51,559 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-09 16:54:51,559 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-09 16:54:51,560 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:51,560 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:51,561 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:51,561 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:51,561 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:51,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:51,561 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:51,561 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:54:51,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:51,561 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:51,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:54:51,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:51,562 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:51,562 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-09 16:54:51,562 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:51,562 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-09 16:54:51,562 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:51,562 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-09 16:54:51,562 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 16:54:51,562 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:54:51,562 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242. 2023-02-09 16:54:51,562 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242. started... 2023-02-09 16:54:51,562 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e4f991fcac5fe84bc0d9e3454023c242 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 16:54:51,974 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509074543aef0c63446b286692aa5bab137ea to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201509074543aef0c63446b286692aa5bab137ea 2023-02-09 16:54:52,379 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/.tmp/family1/3b7f3d465c5d4bf08f4b23d3a30c5a21 2023-02-09 16:54:52,385 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/.tmp/family1/3b7f3d465c5d4bf08f4b23d3a30c5a21 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/3b7f3d465c5d4bf08f4b23d3a30c5a21 2023-02-09 16:54:52,389 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/3b7f3d465c5d4bf08f4b23d3a30c5a21, entries=1, sequenceid=37, filesize=5.0 K 2023-02-09 16:54:52,390 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e4f991fcac5fe84bc0d9e3454023c242 in 828ms, sequenceid=37, compaction requested=true 2023-02-09 16:54:52,390 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e4f991fcac5fe84bc0d9e3454023c242: 2023-02-09 16:54:52,390 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242. 2023-02-09 16:54:52,390 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 16:54:52,390 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 16:54:52,390 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:52,390 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-09 16:54:52,390 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-09 16:54:52,392 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:52,392 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:52,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:52,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:52,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:52,393 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:52,393 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:54:52,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:52,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:52,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:52,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:52,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:52,394 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-09 16:54:52,394 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@45966ef8[Count = 0] remaining members to acquire global barrier 2023-02-09 16:54:52,394 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-09 16:54:52,394 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:52,395 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:52,395 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:52,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:52,395 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-09 16:54:52,395 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-09 16:54:52,395 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:54:52,395 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:52,395 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:54:52,396 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-09 16:54:52,396 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:52,396 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:52,396 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-09 16:54:52,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:52,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:52,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:52,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:52,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:52,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:52,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:52,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:52,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:52,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:52,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:54:52,399 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-09 16:54:52,399 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-09 16:54:52,399 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:54:52,399 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:54:52,399 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:52,399 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:54:52,400 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:52,400 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:52,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:52,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:52,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:52,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:52,400 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:52,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:52,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:52,401 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:52,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:52,401 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:52,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:52,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:52,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:52,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:52,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:52,402 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:52,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:52,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:52,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:52,415 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:52,415 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:52,415 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:52,415 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:52,415 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-09 16:54:52,415 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:54:52,415 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:52,415 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:52,415 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:52,415 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:52,415 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:52,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:52,416 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:52,416 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-09 16:54:52,416 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:52,416 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:54:52,416 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:52,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:52,516 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:54:52,516 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:52,516 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:52,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:54:52,520 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:52,520 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:52,520 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:54:52,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-09 16:54:52,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:52,522 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-09 16:54:52,522 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:52,522 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-09 16:54:52,522 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-09 16:54:52,523 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:52,523 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:52,524 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:52,524 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:52,524 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:52,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:52,524 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:52,524 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:54:52,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:52,525 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:52,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:54:52,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:52,525 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:52,525 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-09 16:54:52,525 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:52,525 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-09 16:54:52,525 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:54:52,525 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-09 16:54:52,525 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 16:54:52,526 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:54:52,526 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242. 2023-02-09 16:54:52,526 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242. started... 2023-02-09 16:54:52,526 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e4f991fcac5fe84bc0d9e3454023c242 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 16:54:52,937 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120a2d805fa44be4b0782d0a018b1c7d33c to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120a2d805fa44be4b0782d0a018b1c7d33c 2023-02-09 16:54:53,342 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/.tmp/family1/b5e8f360a1c949359f47b1b296995d78 2023-02-09 16:54:53,347 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/.tmp/family1/b5e8f360a1c949359f47b1b296995d78 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/b5e8f360a1c949359f47b1b296995d78 2023-02-09 16:54:53,351 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/b5e8f360a1c949359f47b1b296995d78, entries=1, sequenceid=41, filesize=5.0 K 2023-02-09 16:54:53,351 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e4f991fcac5fe84bc0d9e3454023c242 in 825ms, sequenceid=41, compaction requested=true 2023-02-09 16:54:53,352 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e4f991fcac5fe84bc0d9e3454023c242: 2023-02-09 16:54:53,352 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242. 2023-02-09 16:54:53,352 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 16:54:53,352 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 16:54:53,352 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:53,352 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-09 16:54:53,352 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-09 16:54:53,353 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:53,353 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:53,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:53,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:53,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:53,354 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:53,354 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:54:53,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:53,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:53,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:53,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:53,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:53,355 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-09 16:54:53,355 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6d43ed8c[Count = 0] remaining members to acquire global barrier 2023-02-09 16:54:53,355 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-09 16:54:53,355 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:53,357 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:53,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:53,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:53,357 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-09 16:54:53,357 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-09 16:54:53,357 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:54:53,357 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:53,357 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:54:53,358 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-09 16:54:53,358 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:53,358 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:53,358 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-09 16:54:53,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:53,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:53,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:53,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:53,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:53,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:53,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:53,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:53,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:53,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:53,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:54:53,360 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-09 16:54:53,360 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-09 16:54:53,360 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:54:53,360 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:54:53,360 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:53,360 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:54:53,362 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:53,362 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:53,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:53,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:54:53,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:54:53,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:53,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:53,362 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:53,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:54:53,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:53,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:53,362 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:53,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:53,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:53,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:54:53,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:53,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:53,364 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:53,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:54:53,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:53,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:53,365 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:53,366 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:54:53,366 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:53,366 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:54:53,366 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-09 16:54:53,366 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:54:53,366 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:54:53,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:54:53,366 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:54:53,366 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:53,366 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:53,366 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:53,366 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:53,366 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-09 16:54:53,366 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:53,366 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:54:53,366 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:54:53,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:54:53,466 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:54:53,466 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:53,467 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:53,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:54:53,468 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41333] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:53,470 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-09 16:54:53,471 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-09 16:54:53,471 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=42, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675962293471 2023-02-09 16:54:53,471 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 16:54:53,474 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-09 16:54:53,475 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-02-09 16:54:53,475 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-09 16:54:53,475 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] zookeeper.ReadOnlyZKClient(139): Connect 0x0c57a9f9 to 127.0.0.1:53887 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 16:54:53,480 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@26e0f6bc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 16:54:53,480 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-09 16:54:54,316 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601033c8eb5fe30f448fd88043d14a8d0b451 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601033c8eb5fe30f448fd88043d14a8d0b451 2023-02-09 16:54:54,317 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-09 16:54:54,329 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 16:54:54,330 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53430, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 16:54:54,336 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:54,336 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:54,337 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-09 16:54:54,338 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36510, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-09 16:54:54,346 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/7a9afa30bd7549c2b735946f42ad7cc8 first=Optional[r3] last=Optional[r6] 2023-02-09 16:54:54,347 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242., hostname=jenkins-hbase4.apache.org,35511,1675961620699, seqNum=2 for row with hfile group [{family1,hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/7a9afa30bd7549c2b735946f42ad7cc8}] 2023-02-09 16:54:54,351 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(763): Validating hfile at hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/7a9afa30bd7549c2b735946f42ad7cc8 for inclusion in e4f991fcac5fe84bc0d9e3454023c242/family1 2023-02-09 16:54:54,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-02-09 16:54:54,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(777): Region bounds: first= last= 2023-02-09 16:54:54,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HRegion(2445): Flush status journal for e4f991fcac5fe84bc0d9e3454023c242: 2023-02-09 16:54:54,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/7a9afa30bd7549c2b735946f42ad7cc8 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__v6iaa64jdqs10koarbh7r12cjbsbglfajv2jrad6787c281cr0q8u3k3j063i7vr/family1/7a9afa30bd7549c2b735946f42ad7cc8 2023-02-09 16:54:54,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__v6iaa64jdqs10koarbh7r12cjbsbglfajv2jrad6787c281cr0q8u3k3j063i7vr/family1/7a9afa30bd7549c2b735946f42ad7cc8 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/86b1619bb5bb408289bf854852b7f947_SeqId_44_ 2023-02-09 16:54:54,357 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(849): Loaded HFile hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__v6iaa64jdqs10koarbh7r12cjbsbglfajv2jrad6787c281cr0q8u3k3j063i7vr/family1/7a9afa30bd7549c2b735946f42ad7cc8 into e4f991fcac5fe84bc0d9e3454023c242/family1 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/86b1619bb5bb408289bf854852b7f947_SeqId_44_ - updating store file list. 2023-02-09 16:54:54,361 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(882): Loaded HFile hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/86b1619bb5bb408289bf854852b7f947_SeqId_44_ into e4f991fcac5fe84bc0d9e3454023c242/family1 2023-02-09 16:54:54,361 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(855): Successfully loaded hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__v6iaa64jdqs10koarbh7r12cjbsbglfajv2jrad6787c281cr0q8u3k3j063i7vr/family1/7a9afa30bd7549c2b735946f42ad7cc8 into e4f991fcac5fe84bc0d9e3454023c242/family1 (new location: hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/86b1619bb5bb408289bf854852b7f947_SeqId_44_) 2023-02-09 16:54:54,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__v6iaa64jdqs10koarbh7r12cjbsbglfajv2jrad6787c281cr0q8u3k3j063i7vr/family1/7a9afa30bd7549c2b735946f42ad7cc8 2023-02-09 16:54:54,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-09 16:54:54,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51565 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-09 16:54:54,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(1912): e4f991fcac5fe84bc0d9e3454023c242/family1 is initiating minor compaction 2023-02-09 16:54:54,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@627a093c; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 16:54:54,364 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of e4f991fcac5fe84bc0d9e3454023c242/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242. 2023-02-09 16:54:54,365 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/326205c3c37f4fb592256270d10f05db, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/95c9b043da96472a8ab503a6e6cb6116, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/6fe3421ba2ed42d990547d4f1cabd725, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/49337f3359d244ae9a15ab5fa3386947, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/215fa59704d9498fb6960a74eb1e7833, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/f008d5ca8be5415bb3e7f7c3b176ecd7, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/15086a867aeb49edbb37cd7fa108846a, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/3b7f3d465c5d4bf08f4b23d3a30c5a21, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/b5e8f360a1c949359f47b1b296995d78, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/86b1619bb5bb408289bf854852b7f947_SeqId_44_] into tmpdir=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/.tmp, totalSize=50.4 K 2023-02-09 16:54:54,365 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting 326205c3c37f4fb592256270d10f05db, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-09 16:54:54,365 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting 95c9b043da96472a8ab503a6e6cb6116, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-09 16:54:54,365 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting 6fe3421ba2ed42d990547d4f1cabd725, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-09 16:54:54,365 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting 49337f3359d244ae9a15ab5fa3386947, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-09 16:54:54,365 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting 215fa59704d9498fb6960a74eb1e7833, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-09 16:54:54,365 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting f008d5ca8be5415bb3e7f7c3b176ecd7, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-09 16:54:54,365 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting 15086a867aeb49edbb37cd7fa108846a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-09 16:54:54,365 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting 3b7f3d465c5d4bf08f4b23d3a30c5a21, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-09 16:54:54,366 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting b5e8f360a1c949359f47b1b296995d78, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-09 16:54:54,366 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting 86b1619bb5bb408289bf854852b7f947_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-09 16:54:54,366 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-09 16:54:54,367 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 16:54:54,369 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512284653a631f86c42eea051e93ca4cdfe92 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512284653a631f86c42eea051e93ca4cdfe92 2023-02-09 16:54:54,370 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231ff11549d7ebc4b878eac73bd6dac30a3 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231ff11549d7ebc4b878eac73bd6dac30a3 2023-02-09 16:54:54,372 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2016010159833b89b2464789bb626cf2757fef2d to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2016010159833b89b2464789bb626cf2757fef2d 2023-02-09 16:54:54,373 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103a39577825b834e1982aacd60aafd07a4 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103a39577825b834e1982aacd60aafd07a4 2023-02-09 16:54:54,374 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 4 expired mob files are deleted 2023-02-09 16:54:54,374 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-02-09 16:54:54,374 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-09 16:54:54,374 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-09 16:54:54,374 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-09 16:54:54,374 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-09 16:54:54,374 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-09 16:54:54,374 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-09 16:54:54,374 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-09 16:54:54,374 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-09 16:54:54,400 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] throttle.PressureAwareThroughputController(145): e4f991fcac5fe84bc0d9e3454023c242#family1#compaction#61 average throughput is 0.20 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 16:54:54,824 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/.tmp/family1/f639963ddbaa45d4bb19243459029599 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/f639963ddbaa45d4bb19243459029599 2023-02-09 16:54:54,828 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in e4f991fcac5fe84bc0d9e3454023c242/family1 of e4f991fcac5fe84bc0d9e3454023c242 into f639963ddbaa45d4bb19243459029599(size=6.8 K), total size for store is 198.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-09 16:54:54,828 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for e4f991fcac5fe84bc0d9e3454023c242: 2023-02-09 16:54:54,828 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242., storeName=family1, fileCount=10, fileSize=50.4 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1675961694364; duration=0sec 2023-02-09 16:54:54,829 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 16:54:54,836 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205c91ef7981642419ab2ce8bf2fbb55e79 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205c91ef7981642419ab2ce8bf2fbb55e79 2023-02-09 16:54:54,837 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-09 16:54:54,861 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/326205c3c37f4fb592256270d10f05db, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/95c9b043da96472a8ab503a6e6cb6116, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/6fe3421ba2ed42d990547d4f1cabd725, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/49337f3359d244ae9a15ab5fa3386947, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/215fa59704d9498fb6960a74eb1e7833, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/f008d5ca8be5415bb3e7f7c3b176ecd7, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/15086a867aeb49edbb37cd7fa108846a, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/3b7f3d465c5d4bf08f4b23d3a30c5a21, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/b5e8f360a1c949359f47b1b296995d78, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/86b1619bb5bb408289bf854852b7f947_SeqId_44_] to archive 2023-02-09 16:54:54,862 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:54,862 INFO [MobCompactor-pool-0] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:54,862 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 16:54:54,864 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/326205c3c37f4fb592256270d10f05db to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/326205c3c37f4fb592256270d10f05db 2023-02-09 16:54:54,865 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/95c9b043da96472a8ab503a6e6cb6116 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/95c9b043da96472a8ab503a6e6cb6116 2023-02-09 16:54:54,867 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/6fe3421ba2ed42d990547d4f1cabd725 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/6fe3421ba2ed42d990547d4f1cabd725 2023-02-09 16:54:54,868 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/49337f3359d244ae9a15ab5fa3386947 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/49337f3359d244ae9a15ab5fa3386947 2023-02-09 16:54:54,869 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/baf5268b01024655841ebcabdc790273 first=Optional[r00] last=Optional[r2] 2023-02-09 16:54:54,869 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242., hostname=jenkins-hbase4.apache.org,35511,1675961620699, seqNum=2 for row with hfile group [{family1,hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/baf5268b01024655841ebcabdc790273}] 2023-02-09 16:54:54,870 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/215fa59704d9498fb6960a74eb1e7833 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/215fa59704d9498fb6960a74eb1e7833 2023-02-09 16:54:54,871 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/f008d5ca8be5415bb3e7f7c3b176ecd7 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/f008d5ca8be5415bb3e7f7c3b176ecd7 2023-02-09 16:54:54,871 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(763): Validating hfile at hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/baf5268b01024655841ebcabdc790273 for inclusion in e4f991fcac5fe84bc0d9e3454023c242/family1 2023-02-09 16:54:54,872 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/15086a867aeb49edbb37cd7fa108846a to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/15086a867aeb49edbb37cd7fa108846a 2023-02-09 16:54:54,873 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/3b7f3d465c5d4bf08f4b23d3a30c5a21 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/3b7f3d465c5d4bf08f4b23d3a30c5a21 2023-02-09 16:54:54,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-02-09 16:54:54,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(777): Region bounds: first= last= 2023-02-09 16:54:54,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HRegion(2445): Flush status journal for e4f991fcac5fe84bc0d9e3454023c242: 2023-02-09 16:54:54,874 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/b5e8f360a1c949359f47b1b296995d78 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/b5e8f360a1c949359f47b1b296995d78 2023-02-09 16:54:54,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/baf5268b01024655841ebcabdc790273 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__4nmtccb23iruu0c4akof64s3ig7klfga1bi1520bjn70cuiq8h1tjpfri9ri0ef6/family1/baf5268b01024655841ebcabdc790273 2023-02-09 16:54:54,875 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/86b1619bb5bb408289bf854852b7f947_SeqId_44_ to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/86b1619bb5bb408289bf854852b7f947_SeqId_44_ 2023-02-09 16:54:54,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__4nmtccb23iruu0c4akof64s3ig7klfga1bi1520bjn70cuiq8h1tjpfri9ri0ef6/family1/baf5268b01024655841ebcabdc790273 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/b547484474fd47d49ba79a5bb338a4a3_SeqId_47_ 2023-02-09 16:54:54,878 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(849): Loaded HFile hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__4nmtccb23iruu0c4akof64s3ig7klfga1bi1520bjn70cuiq8h1tjpfri9ri0ef6/family1/baf5268b01024655841ebcabdc790273 into e4f991fcac5fe84bc0d9e3454023c242/family1 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/b547484474fd47d49ba79a5bb338a4a3_SeqId_47_ - updating store file list. 2023-02-09 16:54:54,882 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(882): Loaded HFile hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/b547484474fd47d49ba79a5bb338a4a3_SeqId_47_ into e4f991fcac5fe84bc0d9e3454023c242/family1 2023-02-09 16:54:54,882 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(855): Successfully loaded hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__4nmtccb23iruu0c4akof64s3ig7klfga1bi1520bjn70cuiq8h1tjpfri9ri0ef6/family1/baf5268b01024655841ebcabdc790273 into e4f991fcac5fe84bc0d9e3454023c242/family1 (new location: hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/b547484474fd47d49ba79a5bb338a4a3_SeqId_47_) 2023-02-09 16:54:54,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__4nmtccb23iruu0c4akof64s3ig7klfga1bi1520bjn70cuiq8h1tjpfri9ri0ef6/family1/baf5268b01024655841ebcabdc790273 2023-02-09 16:54:54,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-09 16:54:54,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 399433 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-09 16:54:54,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(1912): e4f991fcac5fe84bc0d9e3454023c242/family1 is initiating minor compaction (all files) 2023-02-09 16:54:54,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@7196bb90; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 16:54:54,883 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of e4f991fcac5fe84bc0d9e3454023c242/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242. 2023-02-09 16:54:54,883 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/2450f3f14fb040309bf336675c42a287, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/f639963ddbaa45d4bb19243459029599, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/b547484474fd47d49ba79a5bb338a4a3_SeqId_47_] into tmpdir=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/.tmp, totalSize=390.1 K 2023-02-09 16:54:54,884 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting 2450f3f14fb040309bf336675c42a287, keycount=1000, bloomtype=ROW, size=191.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878845085 2023-02-09 16:54:54,884 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting f639963ddbaa45d4bb19243459029599, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621245085 2023-02-09 16:54:54,884 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting b547484474fd47d49ba79a5bb338a4a3_SeqId_47_, keycount=1002, bloomtype=ROW, size=191.8 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878845085 2023-02-09 16:54:54,885 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-09 16:54:54,886 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 16:54:54,887 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511308730ff1d4d354bc6a4effd3dd6c2fde5 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511308730ff1d4d354bc6a4effd3dd6c2fde5 2023-02-09 16:54:54,889 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201271d8a4500694aca96e7de1d6e77d535 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201271d8a4500694aca96e7de1d6e77d535 2023-02-09 16:54:54,890 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205a11dc5ffcc2d4e0ea8ba0e7bac977789 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205a11dc5ffcc2d4e0ea8ba0e7bac977789 2023-02-09 16:54:54,890 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 3 expired mob files are deleted 2023-02-09 16:54:54,890 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-02-09 16:54:54,890 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-09 16:54:54,890 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-09 16:54:54,890 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 16:54:54,892 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=42, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-09 16:54:54,893 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 1.4230 sec 2023-02-09 16:54:54,901 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] throttle.PressureAwareThroughputController(145): e4f991fcac5fe84bc0d9e3454023c242#family1#compaction#62 average throughput is 22.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 16:54:54,965 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:54,965 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:54,966 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.HMaster$12(2441): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-02-09 16:54:54,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure2.ProcedureExecutor(1029): Stored pid=43, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:55,376 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-02-09 16:54:55,377 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-02-09 16:54:55,377 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-02-09 16:54:55,379 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=43, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-02-09 16:54:55,382 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=e4f991fcac5fe84bc0d9e3454023c242, REOPEN/MOVE}] 2023-02-09 16:54:55,383 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=e4f991fcac5fe84bc0d9e3454023c242, REOPEN/MOVE 2023-02-09 16:54:55,383 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=e4f991fcac5fe84bc0d9e3454023c242, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:55,384 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1675961695383"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675961695383"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675961695383"}]},"ts":"1675961695383"} 2023-02-09 16:54:55,385 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=45, state=RUNNABLE; CloseRegionProcedure e4f991fcac5fe84bc0d9e3454023c242, server=jenkins-hbase4.apache.org,35511,1675961620699}] 2023-02-09 16:54:55,537 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close e4f991fcac5fe84bc0d9e3454023c242 2023-02-09 16:54:55,537 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing e4f991fcac5fe84bc0d9e3454023c242, disabling compactions & flushes 2023-02-09 16:54:55,537 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1857): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242. 2023-02-09 16:54:56,117 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/.tmp/family1/330ee5e50db442c0a903bdc1e28a62d2 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/330ee5e50db442c0a903bdc1e28a62d2 2023-02-09 16:54:56,122 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in e4f991fcac5fe84bc0d9e3454023c242/family1 of e4f991fcac5fe84bc0d9e3454023c242 into 330ee5e50db442c0a903bdc1e28a62d2(size=193.0 K), total size for store is 193.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-09 16:54:56,122 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for e4f991fcac5fe84bc0d9e3454023c242: 2023-02-09 16:54:56,122 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242. 2023-02-09 16:54:56,122 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242. 2023-02-09 16:54:56,122 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242., storeName=family1, fileCount=3, fileSize=390.1 K (191.4 K, 6.8 K, 191.8 K), priority=2, time=1675961694883; duration=1sec 2023-02-09 16:54:56,122 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242. after waiting 0 ms 2023-02-09 16:54:56,122 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242. 2023-02-09 16:54:56,122 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 16:54:56,124 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/2450f3f14fb040309bf336675c42a287, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/f639963ddbaa45d4bb19243459029599, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/b547484474fd47d49ba79a5bb338a4a3_SeqId_47_] to archive 2023-02-09 16:54:56,124 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 16:54:56,126 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/2450f3f14fb040309bf336675c42a287 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/2450f3f14fb040309bf336675c42a287 2023-02-09 16:54:56,127 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/f639963ddbaa45d4bb19243459029599 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/f639963ddbaa45d4bb19243459029599 2023-02-09 16:54:56,128 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/b547484474fd47d49ba79a5bb338a4a3_SeqId_47_ to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/b547484474fd47d49ba79a5bb338a4a3_SeqId_47_ 2023-02-09 16:54:56,132 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-02-09 16:54:56,133 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242. 2023-02-09 16:54:56,133 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for e4f991fcac5fe84bc0d9e3454023c242: Waiting for close lock at 1675961695537Running coprocessor pre-close hooks at 1675961695537Disabling compacts and flushes for region at 1675961695537Disabling writes for close at 1675961696122 (+585 ms)Writing region close event to WAL at 1675961696129 (+7 ms)Running coprocessor post-close hooks at 1675961696132 (+3 ms)Closed at 1675961696133 (+1 ms) 2023-02-09 16:54:56,133 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3509): Not adding moved region record: e4f991fcac5fe84bc0d9e3454023c242 to self. 2023-02-09 16:54:56,134 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed e4f991fcac5fe84bc0d9e3454023c242 2023-02-09 16:54:56,135 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=e4f991fcac5fe84bc0d9e3454023c242, regionState=CLOSED 2023-02-09 16:54:56,135 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1675961696135"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675961696135"}]},"ts":"1675961696135"} 2023-02-09 16:54:56,137 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=45 2023-02-09 16:54:56,137 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=45, state=SUCCESS; CloseRegionProcedure e4f991fcac5fe84bc0d9e3454023c242, server=jenkins-hbase4.apache.org,35511,1675961620699 in 751 msec 2023-02-09 16:54:56,138 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=e4f991fcac5fe84bc0d9e3454023c242, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,35511,1675961620699; forceNewPlan=false, retain=true 2023-02-09 16:54:56,288 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=e4f991fcac5fe84bc0d9e3454023c242, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:56,288 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1675961696288"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675961696288"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675961696288"}]},"ts":"1675961696288"} 2023-02-09 16:54:56,290 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=45, state=RUNNABLE; OpenRegionProcedure e4f991fcac5fe84bc0d9e3454023c242, server=jenkins-hbase4.apache.org,35511,1675961620699}] 2023-02-09 16:54:56,444 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242. 2023-02-09 16:54:56,445 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e4f991fcac5fe84bc0d9e3454023c242, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242.', STARTKEY => '', ENDKEY => ''} 2023-02-09 16:54:56,445 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly e4f991fcac5fe84bc0d9e3454023c242 2023-02-09 16:54:56,445 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 16:54:56,445 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for e4f991fcac5fe84bc0d9e3454023c242 2023-02-09 16:54:56,445 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for e4f991fcac5fe84bc0d9e3454023c242 2023-02-09 16:54:56,446 INFO [StoreOpener-e4f991fcac5fe84bc0d9e3454023c242-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region e4f991fcac5fe84bc0d9e3454023c242 2023-02-09 16:54:56,447 DEBUG [StoreOpener-e4f991fcac5fe84bc0d9e3454023c242-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1 2023-02-09 16:54:56,447 DEBUG [StoreOpener-e4f991fcac5fe84bc0d9e3454023c242-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1 2023-02-09 16:54:56,447 INFO [StoreOpener-e4f991fcac5fe84bc0d9e3454023c242-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e4f991fcac5fe84bc0d9e3454023c242 columnFamilyName family1 2023-02-09 16:54:56,452 DEBUG [StoreOpener-e4f991fcac5fe84bc0d9e3454023c242-1] regionserver.HStore(539): loaded hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/330ee5e50db442c0a903bdc1e28a62d2 2023-02-09 16:54:56,452 INFO [StoreOpener-e4f991fcac5fe84bc0d9e3454023c242-1] regionserver.HStore(310): Store=e4f991fcac5fe84bc0d9e3454023c242/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 16:54:56,453 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242 2023-02-09 16:54:56,454 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242 2023-02-09 16:54:56,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for e4f991fcac5fe84bc0d9e3454023c242 2023-02-09 16:54:56,457 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened e4f991fcac5fe84bc0d9e3454023c242; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75202477, jitterRate=0.12060423195362091}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 16:54:56,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for e4f991fcac5fe84bc0d9e3454023c242: Running coprocessor pre-open hook at 1675961696445Writing region info on filesystem at 1675961696445Initializing all the Stores at 1675961696446 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} at 1675961696446Cleaning up temporary data from old regions at 1675961696454 (+8 ms)Cleaning up detritus from prior splits at 1675961696454Running coprocessor post-open hooks at 1675961696457 (+3 ms)Region opened successfully at 1675961696457 2023-02-09 16:54:56,457 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242., pid=47, masterSystemTime=1675961696441 2023-02-09 16:54:56,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242. 2023-02-09 16:54:56,459 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242. 2023-02-09 16:54:56,459 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=e4f991fcac5fe84bc0d9e3454023c242, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:56,459 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1675961696459"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675961696459"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675961696459"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675961696459"}]},"ts":"1675961696459"} 2023-02-09 16:54:56,461 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=45 2023-02-09 16:54:56,461 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=45, state=SUCCESS; OpenRegionProcedure e4f991fcac5fe84bc0d9e3454023c242, server=jenkins-hbase4.apache.org,35511,1675961620699 in 170 msec 2023-02-09 16:54:56,463 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-02-09 16:54:56,463 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=e4f991fcac5fe84bc0d9e3454023c242, REOPEN/MOVE in 1.0790 sec 2023-02-09 16:54:56,464 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=43 2023-02-09 16:54:56,464 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=43, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.0840 sec 2023-02-09 16:54:56,466 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=43, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.4990 sec 2023-02-09 16:54:56,466 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:56,466 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:56,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=43 2023-02-09 16:54:56,467 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:56,467 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:56,467 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:56,467 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:56,468 INFO [Listener at localhost/41619] compactions.TestMobCompactor(278): alter status finished 2023-02-09 16:54:56,469 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41333] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:56,470 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-09 16:54:56,470 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-09 16:54:56,471 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675962296471 2023-02-09 16:54:56,471 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 16:54:56,473 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-09 16:54:56,473 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-02-09 16:54:56,473 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-09 16:54:56,474 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] zookeeper.ReadOnlyZKClient(139): Connect 0x094fe8e0 to 127.0.0.1:53887 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 16:54:56,478 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@283baa63, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 16:54:56,478 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-09 16:54:56,478 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-09 16:54:56,479 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-09 16:54:56,479 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-09 16:54:56,479 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-09 16:54:56,910 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511284be7e20f5fbc4b0d89be2da4fa914f2d to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511284be7e20f5fbc4b0d89be2da4fa914f2d 2023-02-09 16:54:56,911 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-09 16:54:56,923 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 16:54:56,924 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53442, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 16:54:56,930 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:56,930 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:56,931 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-09 16:54:56,932 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36518, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-09 16:54:56,941 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/0b9eb816f1c74434a30f7d32e3216fa9 first=Optional[r05] last=Optional[r8] 2023-02-09 16:54:56,941 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242., hostname=jenkins-hbase4.apache.org,35511,1675961620699, seqNum=51 for row with hfile group [{family1,hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/0b9eb816f1c74434a30f7d32e3216fa9}] 2023-02-09 16:54:56,945 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(763): Validating hfile at hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/0b9eb816f1c74434a30f7d32e3216fa9 for inclusion in e4f991fcac5fe84bc0d9e3454023c242/family1 2023-02-09 16:54:56,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-02-09 16:54:56,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(777): Region bounds: first= last= 2023-02-09 16:54:56,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HRegion(2445): Flush status journal for e4f991fcac5fe84bc0d9e3454023c242: 2023-02-09 16:54:56,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/0b9eb816f1c74434a30f7d32e3216fa9 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__n453amq7rl3vb4u7mgqpqbjltfg4m4te7mqsatf7fpk39ra85uspp05m5coaj93p/family1/0b9eb816f1c74434a30f7d32e3216fa9 2023-02-09 16:54:56,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__n453amq7rl3vb4u7mgqpqbjltfg4m4te7mqsatf7fpk39ra85uspp05m5coaj93p/family1/0b9eb816f1c74434a30f7d32e3216fa9 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/aef11b3df50345698bb086831d25ce15_SeqId_53_ 2023-02-09 16:54:56,952 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(849): Loaded HFile hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__n453amq7rl3vb4u7mgqpqbjltfg4m4te7mqsatf7fpk39ra85uspp05m5coaj93p/family1/0b9eb816f1c74434a30f7d32e3216fa9 into e4f991fcac5fe84bc0d9e3454023c242/family1 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/aef11b3df50345698bb086831d25ce15_SeqId_53_ - updating store file list. 2023-02-09 16:54:56,955 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(882): Loaded HFile hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/aef11b3df50345698bb086831d25ce15_SeqId_53_ into e4f991fcac5fe84bc0d9e3454023c242/family1 2023-02-09 16:54:56,955 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(855): Successfully loaded hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__n453amq7rl3vb4u7mgqpqbjltfg4m4te7mqsatf7fpk39ra85uspp05m5coaj93p/family1/0b9eb816f1c74434a30f7d32e3216fa9 into e4f991fcac5fe84bc0d9e3454023c242/family1 (new location: hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/aef11b3df50345698bb086831d25ce15_SeqId_53_) 2023-02-09 16:54:56,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__n453amq7rl3vb4u7mgqpqbjltfg4m4te7mqsatf7fpk39ra85uspp05m5coaj93p/family1/0b9eb816f1c74434a30f7d32e3216fa9 2023-02-09 16:54:56,957 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-09 16:54:56,958 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 16:54:56,959 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120a2d805fa44be4b0782d0a018b1c7d33c to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120a2d805fa44be4b0782d0a018b1c7d33c 2023-02-09 16:54:56,960 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511285bebc0004bac4d58819acb0b54156650 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511285bebc0004bac4d58819acb0b54156650 2023-02-09 16:54:56,960 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2 expired mob files are deleted 2023-02-09 16:54:56,960 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-02-09 16:54:56,961 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-09 16:54:56,961 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-09 16:54:56,961 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-09 16:54:56,961 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-09 16:54:56,961 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 16:54:56,962 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-09 16:54:56,963 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 493 msec 2023-02-09 16:54:57,011 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:57,011 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:57,012 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.HMaster$12(2441): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-09 16:54:57,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:57,427 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-02-09 16:54:57,428 DEBUG [PEWorker-2] util.FSTableDescriptors(519): Deleted hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-02-09 16:54:57,428 INFO [PEWorker-2] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-02-09 16:54:57,430 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=49, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-02-09 16:54:57,434 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=e4f991fcac5fe84bc0d9e3454023c242, REOPEN/MOVE}] 2023-02-09 16:54:57,434 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=e4f991fcac5fe84bc0d9e3454023c242, REOPEN/MOVE 2023-02-09 16:54:57,435 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=e4f991fcac5fe84bc0d9e3454023c242, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:57,435 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1675961697435"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675961697435"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675961697435"}]},"ts":"1675961697435"} 2023-02-09 16:54:57,437 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE; CloseRegionProcedure e4f991fcac5fe84bc0d9e3454023c242, server=jenkins-hbase4.apache.org,35511,1675961620699}] 2023-02-09 16:54:57,589 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close e4f991fcac5fe84bc0d9e3454023c242 2023-02-09 16:54:57,589 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing e4f991fcac5fe84bc0d9e3454023c242, disabling compactions & flushes 2023-02-09 16:54:57,589 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242. 2023-02-09 16:54:57,589 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242. 2023-02-09 16:54:57,589 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242. after waiting 0 ms 2023-02-09 16:54:57,589 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242. 2023-02-09 16:54:57,595 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-02-09 16:54:57,595 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242. 2023-02-09 16:54:57,596 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for e4f991fcac5fe84bc0d9e3454023c242: Waiting for close lock at 1675961697589Running coprocessor pre-close hooks at 1675961697589Disabling compacts and flushes for region at 1675961697589Disabling writes for close at 1675961697589Writing region close event to WAL at 1675961697591 (+2 ms)Running coprocessor post-close hooks at 1675961697595 (+4 ms)Closed at 1675961697595 2023-02-09 16:54:57,596 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3509): Not adding moved region record: e4f991fcac5fe84bc0d9e3454023c242 to self. 2023-02-09 16:54:57,597 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed e4f991fcac5fe84bc0d9e3454023c242 2023-02-09 16:54:57,597 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=e4f991fcac5fe84bc0d9e3454023c242, regionState=CLOSED 2023-02-09 16:54:57,598 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1675961697597"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675961697597"}]},"ts":"1675961697597"} 2023-02-09 16:54:57,600 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-02-09 16:54:57,600 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; CloseRegionProcedure e4f991fcac5fe84bc0d9e3454023c242, server=jenkins-hbase4.apache.org,35511,1675961620699 in 162 msec 2023-02-09 16:54:57,601 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=e4f991fcac5fe84bc0d9e3454023c242, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,35511,1675961620699; forceNewPlan=false, retain=true 2023-02-09 16:54:57,751 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=e4f991fcac5fe84bc0d9e3454023c242, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:57,751 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1675961697751"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675961697751"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675961697751"}]},"ts":"1675961697751"} 2023-02-09 16:54:57,753 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=51, state=RUNNABLE; OpenRegionProcedure e4f991fcac5fe84bc0d9e3454023c242, server=jenkins-hbase4.apache.org,35511,1675961620699}] 2023-02-09 16:54:57,907 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242. 2023-02-09 16:54:57,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e4f991fcac5fe84bc0d9e3454023c242, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242.', STARTKEY => '', ENDKEY => ''} 2023-02-09 16:54:57,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly e4f991fcac5fe84bc0d9e3454023c242 2023-02-09 16:54:57,908 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 16:54:57,908 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for e4f991fcac5fe84bc0d9e3454023c242 2023-02-09 16:54:57,908 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for e4f991fcac5fe84bc0d9e3454023c242 2023-02-09 16:54:57,909 INFO [StoreOpener-e4f991fcac5fe84bc0d9e3454023c242-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region e4f991fcac5fe84bc0d9e3454023c242 2023-02-09 16:54:57,910 DEBUG [StoreOpener-e4f991fcac5fe84bc0d9e3454023c242-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1 2023-02-09 16:54:57,910 DEBUG [StoreOpener-e4f991fcac5fe84bc0d9e3454023c242-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1 2023-02-09 16:54:57,910 INFO [StoreOpener-e4f991fcac5fe84bc0d9e3454023c242-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e4f991fcac5fe84bc0d9e3454023c242 columnFamilyName family1 2023-02-09 16:54:57,915 DEBUG [StoreOpener-e4f991fcac5fe84bc0d9e3454023c242-1] regionserver.HStore(539): loaded hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/330ee5e50db442c0a903bdc1e28a62d2 2023-02-09 16:54:57,918 DEBUG [StoreOpener-e4f991fcac5fe84bc0d9e3454023c242-1] regionserver.HStore(539): loaded hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/family1/aef11b3df50345698bb086831d25ce15_SeqId_53_ 2023-02-09 16:54:57,918 INFO [StoreOpener-e4f991fcac5fe84bc0d9e3454023c242-1] regionserver.HStore(310): Store=e4f991fcac5fe84bc0d9e3454023c242/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 16:54:57,919 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242 2023-02-09 16:54:57,920 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242 2023-02-09 16:54:57,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for e4f991fcac5fe84bc0d9e3454023c242 2023-02-09 16:54:57,923 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened e4f991fcac5fe84bc0d9e3454023c242; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68204807, jitterRate=0.016330823302268982}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 16:54:57,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for e4f991fcac5fe84bc0d9e3454023c242: Running coprocessor pre-open hook at 1675961697908Writing region info on filesystem at 1675961697908Initializing all the Stores at 1675961697908Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1675961697908Cleaning up temporary data from old regions at 1675961697921 (+13 ms)Cleaning up detritus from prior splits at 1675961697921Running coprocessor post-open hooks at 1675961697923 (+2 ms)Region opened successfully at 1675961697923 2023-02-09 16:54:57,924 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242., pid=53, masterSystemTime=1675961697904 2023-02-09 16:54:57,925 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242. 2023-02-09 16:54:57,925 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242. 2023-02-09 16:54:57,926 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=e4f991fcac5fe84bc0d9e3454023c242, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:57,926 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1675961697926"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675961697926"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675961697926"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675961697926"}]},"ts":"1675961697926"} 2023-02-09 16:54:57,929 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-02-09 16:54:57,929 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; OpenRegionProcedure e4f991fcac5fe84bc0d9e3454023c242, server=jenkins-hbase4.apache.org,35511,1675961620699 in 174 msec 2023-02-09 16:54:57,930 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=50 2023-02-09 16:54:57,930 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=50, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=e4f991fcac5fe84bc0d9e3454023c242, REOPEN/MOVE in 495 msec 2023-02-09 16:54:57,932 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=49 2023-02-09 16:54:57,932 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=49, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 501 msec 2023-02-09 16:54:57,933 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 920 msec 2023-02-09 16:54:57,934 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:57,934 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:57,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=49 2023-02-09 16:54:57,935 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:57,935 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:57,935 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:57,935 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:57,936 INFO [Listener at localhost/41619] compactions.TestMobCompactor(278): alter status finished 2023-02-09 16:54:57,936 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41333] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 16:54:57,938 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-09 16:54:57,938 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-09 16:54:57,939 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=54, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675962297939 2023-02-09 16:54:57,940 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 16:54:57,940 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-09 16:54:57,941 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-02-09 16:54:57,941 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-09 16:54:57,941 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] zookeeper.ReadOnlyZKClient(139): Connect 0x5a4bcd7d to 127.0.0.1:53887 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 16:54:57,945 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2fd61ce5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 16:54:57,946 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-09 16:54:57,946 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-09 16:54:57,946 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-09 16:54:57,946 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-09 16:54:57,946 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-09 16:54:57,946 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-09 16:54:57,946 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-09 16:54:57,946 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-09 16:54:57,946 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-09 16:54:57,946 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 16:54:57,947 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=54, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-09 16:54:57,948 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 10 msec 2023-02-09 16:54:57,995 INFO [Listener at localhost/41619] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=247 (was 255), OpenFileDescriptor=625 (was 615) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=175 (was 177), ProcessCount=168 (was 168), AvailableMemoryMB=3101 (was 3113) 2023-02-09 16:54:58,007 INFO [Listener at localhost/41619] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=247, OpenFileDescriptor=625, MaxFileDescriptor=60000, SystemLoadAverage=175, ProcessCount=168, AvailableMemoryMB=3100 2023-02-09 16:54:58,008 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:58,008 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:58,009 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-09 16:54:58,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure2.ProcedureExecutor(1029): Stored pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:54:58,012 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 16:54:58,012 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily" procId is: 55 2023-02-09 16:54:58,012 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:58,012 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:58,012 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 16:54:58,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-09 16:54:58,014 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2 2023-02-09 16:54:58,014 DEBUG [HFileArchiver-10] backup.HFileArchiver(153): Directory hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2 empty. 2023-02-09 16:54:58,014 DEBUG [HFileArchiver-10] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2 2023-02-09 16:54:58,015 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily regions 2023-02-09 16:54:58,113 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:58,113 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:58,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-09 16:54:58,314 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:58,315 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:58,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-09 16:54:58,423 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-02-09 16:54:58,424 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(7671): creating {ENCODED => 598aece21dfd9476b532637bf96ec2b2, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp 2023-02-09 16:54:58,616 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:58,616 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:58,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-09 16:54:58,829 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 16:54:58,829 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1603): Closing 598aece21dfd9476b532637bf96ec2b2, disabling compactions & flushes 2023-02-09 16:54:58,830 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2. 2023-02-09 16:54:58,830 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2. 2023-02-09 16:54:58,830 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2. after waiting 0 ms 2023-02-09 16:54:58,830 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2. 2023-02-09 16:54:58,830 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2. 2023-02-09 16:54:58,830 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1557): Region close journal for 598aece21dfd9476b532637bf96ec2b2: Waiting for close lock at 1675961698829Disabling compacts and flushes for region at 1675961698829Disabling writes for close at 1675961698830 (+1 ms)Writing region close event to WAL at 1675961698830Closed at 1675961698830 2023-02-09 16:54:58,832 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 16:54:58,833 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1675961698833"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675961698833"}]},"ts":"1675961698833"} 2023-02-09 16:54:58,834 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-09 16:54:58,834 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 16:54:58,835 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675961698835"}]},"ts":"1675961698835"} 2023-02-09 16:54:58,835 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLING in hbase:meta 2023-02-09 16:54:58,838 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=598aece21dfd9476b532637bf96ec2b2, ASSIGN}] 2023-02-09 16:54:58,840 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=598aece21dfd9476b532637bf96ec2b2, ASSIGN 2023-02-09 16:54:58,840 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=598aece21dfd9476b532637bf96ec2b2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35511,1675961620699; forceNewPlan=false, retain=false 2023-02-09 16:54:58,991 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=598aece21dfd9476b532637bf96ec2b2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:58,991 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1675961698991"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675961698991"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675961698991"}]},"ts":"1675961698991"} 2023-02-09 16:54:58,993 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=57, ppid=56, state=RUNNABLE; OpenRegionProcedure 598aece21dfd9476b532637bf96ec2b2, server=jenkins-hbase4.apache.org,35511,1675961620699}] 2023-02-09 16:54:59,117 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:54:59,117 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:54:59,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-09 16:54:59,147 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2. 2023-02-09 16:54:59,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 598aece21dfd9476b532637bf96ec2b2, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2.', STARTKEY => '', ENDKEY => ''} 2023-02-09 16:54:59,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 598aece21dfd9476b532637bf96ec2b2 2023-02-09 16:54:59,148 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 16:54:59,148 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 598aece21dfd9476b532637bf96ec2b2 2023-02-09 16:54:59,148 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 598aece21dfd9476b532637bf96ec2b2 2023-02-09 16:54:59,149 INFO [StoreOpener-598aece21dfd9476b532637bf96ec2b2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 598aece21dfd9476b532637bf96ec2b2 2023-02-09 16:54:59,150 DEBUG [StoreOpener-598aece21dfd9476b532637bf96ec2b2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1 2023-02-09 16:54:59,150 DEBUG [StoreOpener-598aece21dfd9476b532637bf96ec2b2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1 2023-02-09 16:54:59,150 INFO [StoreOpener-598aece21dfd9476b532637bf96ec2b2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 598aece21dfd9476b532637bf96ec2b2 columnFamilyName family1 2023-02-09 16:54:59,152 INFO [StoreOpener-598aece21dfd9476b532637bf96ec2b2-1] regionserver.HStore(310): Store=598aece21dfd9476b532637bf96ec2b2/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 16:54:59,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2 2023-02-09 16:54:59,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2 2023-02-09 16:54:59,156 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 598aece21dfd9476b532637bf96ec2b2 2023-02-09 16:54:59,157 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 16:54:59,158 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 598aece21dfd9476b532637bf96ec2b2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69934788, jitterRate=0.042109549045562744}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 16:54:59,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 598aece21dfd9476b532637bf96ec2b2: Running coprocessor pre-open hook at 1675961699148Writing region info on filesystem at 1675961699148Initializing all the Stores at 1675961699148Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1675961699149 (+1 ms)Cleaning up temporary data from old regions at 1675961699153 (+4 ms)Cleaning up detritus from prior splits at 1675961699154 (+1 ms)Running coprocessor post-open hooks at 1675961699158 (+4 ms)Region opened successfully at 1675961699158 2023-02-09 16:54:59,158 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2., pid=57, masterSystemTime=1675961699144 2023-02-09 16:54:59,160 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2. 2023-02-09 16:54:59,160 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2. 2023-02-09 16:54:59,160 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=598aece21dfd9476b532637bf96ec2b2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:54:59,160 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1675961699160"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675961699160"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675961699160"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675961699160"}]},"ts":"1675961699160"} 2023-02-09 16:54:59,163 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=57, resume processing ppid=56 2023-02-09 16:54:59,163 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=57, ppid=56, state=SUCCESS; OpenRegionProcedure 598aece21dfd9476b532637bf96ec2b2, server=jenkins-hbase4.apache.org,35511,1675961620699 in 168 msec 2023-02-09 16:54:59,164 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=56, resume processing ppid=55 2023-02-09 16:54:59,164 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=56, ppid=55, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=598aece21dfd9476b532637bf96ec2b2, ASSIGN in 325 msec 2023-02-09 16:54:59,164 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 16:54:59,165 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675961699165"}]},"ts":"1675961699165"} 2023-02-09 16:54:59,165 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLED in hbase:meta 2023-02-09 16:54:59,168 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 16:54:59,169 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=55, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.1590 sec 2023-02-09 16:55:00,118 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:00,118 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:00,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-09 16:55:00,119 INFO [Listener at localhost/41619] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, procId: 55 completed 2023-02-09 16:55:00,138 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:00,138 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:00,138 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:55:00,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:00,140 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-09 16:55:00,141 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:55:00,141 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-09 16:55:00,141 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-09 16:55:00,141 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:00,141 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:00,142 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:00,142 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:55:00,142 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:55:00,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:55:00,143 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:00,143 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:55:00,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:00,143 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:00,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:55:00,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:00,144 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:00,144 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:00,144 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-09 16:55:00,144 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:55:00,144 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-09 16:55:00,144 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 16:55:00,144 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:55:00,144 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2. 2023-02-09 16:55:00,144 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2. started... 2023-02-09 16:55:00,145 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 598aece21dfd9476b532637bf96ec2b2 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-09 16:55:00,167 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130863c7a4a55e247598491ff1fc5ba627c to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130863c7a4a55e247598491ff1fc5ba627c 2023-02-09 16:55:00,226 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-09 16:55:00,571 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/.tmp/family1/adbafb43c87246dd98e6b890da590b6b 2023-02-09 16:55:00,575 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/.tmp/family1/adbafb43c87246dd98e6b890da590b6b as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/adbafb43c87246dd98e6b890da590b6b 2023-02-09 16:55:00,579 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/adbafb43c87246dd98e6b890da590b6b, entries=1000, sequenceid=5, filesize=190.5 K 2023-02-09 16:55:00,580 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 598aece21dfd9476b532637bf96ec2b2 in 435ms, sequenceid=5, compaction requested=false 2023-02-09 16:55:00,581 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 598aece21dfd9476b532637bf96ec2b2: 2023-02-09 16:55:00,581 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2. 2023-02-09 16:55:00,581 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 16:55:00,581 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 16:55:00,581 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:00,581 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-09 16:55:00,581 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-09 16:55:00,583 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:00,583 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:00,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:00,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:55:00,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:55:00,583 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:00,583 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:55:00,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:55:00,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:55:00,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:00,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:00,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:55:00,584 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-09 16:55:00,584 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@304b8727[Count = 0] remaining members to acquire global barrier 2023-02-09 16:55:00,584 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-09 16:55:00,584 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:00,585 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:00,585 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:00,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:00,585 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-09 16:55:00,585 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-09 16:55:00,585 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:00,585 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:55:00,585 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:55:00,588 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-09 16:55:00,588 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:55:00,588 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:00,588 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-09 16:55:00,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:00,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:55:00,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:55:00,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:55:00,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:55:00,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:00,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:00,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:55:00,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:00,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:00,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:55:00,590 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-09 16:55:00,590 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-09 16:55:00,590 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:55:00,590 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:55:00,590 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:00,590 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:55:00,592 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:00,592 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:00,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:00,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:55:00,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:55:00,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:00,592 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:55:00,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:00,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:55:00,592 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:00,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:55:00,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:55:00,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:00,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:00,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:55:00,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:00,593 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:00,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:00,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:55:00,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:00,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:00,598 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:00,598 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:55:00,598 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:00,598 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:55:00,598 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-09 16:55:00,598 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:55:00,598 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:00,598 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:55:00,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:55:00,598 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:55:00,598 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:00,598 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:00,598 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:00,598 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-09 16:55:00,598 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:55:00,598 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:00,598 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:55:00,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:55:00,699 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:55:00,699 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:00,699 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:00,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:55:00,703 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:00,703 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:00,704 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:55:00,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-09 16:55:00,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:00,705 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-09 16:55:00,705 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:55:00,705 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-09 16:55:00,705 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-09 16:55:00,706 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:00,706 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:00,707 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:00,707 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:55:00,707 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:55:00,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:55:00,707 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:00,707 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:55:00,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:00,708 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:00,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:55:00,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:00,708 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:00,708 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-09 16:55:00,708 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:00,708 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-09 16:55:00,708 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:55:00,708 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-09 16:55:00,709 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 16:55:00,709 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:55:00,709 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2. 2023-02-09 16:55:00,709 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2. started... 2023-02-09 16:55:00,709 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 598aece21dfd9476b532637bf96ec2b2 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-09 16:55:01,122 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511284a04962d7ef84a659d3a6ac02e57cccf to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511284a04962d7ef84a659d3a6ac02e57cccf 2023-02-09 16:55:01,533 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/.tmp/family1/0639c3c836e449cd829665a166789976 2023-02-09 16:55:01,537 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/.tmp/family1/0639c3c836e449cd829665a166789976 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/0639c3c836e449cd829665a166789976 2023-02-09 16:55:01,559 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5a4bcd7d to 127.0.0.1:53887 2023-02-09 16:55:01,559 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 16:55:01,559 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-09 16:55:01,559 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x094fe8e0 to 127.0.0.1:53887 2023-02-09 16:55:01,559 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 16:55:01,559 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-09 16:55:01,559 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0c57a9f9 to 127.0.0.1:53887 2023-02-09 16:55:01,559 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 16:55:01,559 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-09 16:55:01,560 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x65081758 to 127.0.0.1:53887 2023-02-09 16:55:01,560 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 16:55:01,560 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-09 16:55:01,560 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7d148e5c to 127.0.0.1:53887 2023-02-09 16:55:01,560 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 16:55:01,563 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/0639c3c836e449cd829665a166789976, entries=1, sequenceid=9, filesize=5.0 K 2023-02-09 16:55:01,563 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 598aece21dfd9476b532637bf96ec2b2 in 854ms, sequenceid=9, compaction requested=false 2023-02-09 16:55:01,564 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 598aece21dfd9476b532637bf96ec2b2: 2023-02-09 16:55:01,564 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2. 2023-02-09 16:55:01,564 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 16:55:01,564 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 16:55:01,564 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:01,564 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-09 16:55:01,564 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-09 16:55:01,566 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:01,566 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:01,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:01,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:55:01,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:55:01,566 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:01,566 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:55:01,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:55:01,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:55:01,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:01,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:01,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:55:01,567 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-09 16:55:01,567 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@59af76c[Count = 0] remaining members to acquire global barrier 2023-02-09 16:55:01,567 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-09 16:55:01,567 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:01,568 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:01,568 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:01,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:01,569 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-09 16:55:01,569 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-09 16:55:01,569 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:55:01,569 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:01,569 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:55:01,570 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-09 16:55:01,570 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:01,570 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:55:01,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:01,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:55:01,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:55:01,570 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-09 16:55:01,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:55:01,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:55:01,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:01,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:01,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:55:01,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:01,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:01,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:55:01,572 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-09 16:55:01,572 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-09 16:55:01,572 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:55:01,572 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:55:01,572 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:01,572 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:55:01,574 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:01,574 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:01,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:01,574 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:55:01,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:55:01,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:55:01,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:01,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:01,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:55:01,574 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:01,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:55:01,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:55:01,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:01,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:01,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:55:01,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:01,575 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:01,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:01,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:55:01,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:01,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:01,579 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:55:01,579 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:55:01,579 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:55:01,579 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:01,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:55:01,579 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:01,579 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:55:01,579 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-09 16:55:01,579 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:55:01,579 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:01,579 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:01,579 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:01,579 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:01,579 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:01,579 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:55:01,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:55:01,579 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-09 16:55:01,580 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:55:01,579 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-09 16:55:01,675 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-09 16:55:01,680 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:55:01,680 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:01,680 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:01,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:55:01,684 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:01,684 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:01,685 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:55:01,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-09 16:55:01,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:01,687 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-09 16:55:01,687 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:55:01,687 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-09 16:55:01,687 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-09 16:55:01,687 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:01,687 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:01,689 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:01,689 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:55:01,689 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:55:01,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:55:01,689 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:01,689 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:55:01,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:01,690 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:01,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:55:01,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:01,690 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:01,690 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-09 16:55:01,690 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:01,690 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-09 16:55:01,690 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:55:01,690 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-09 16:55:01,691 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 16:55:01,691 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:55:01,691 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2. 2023-02-09 16:55:01,691 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2. started... 2023-02-09 16:55:01,691 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 598aece21dfd9476b532637bf96ec2b2 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 16:55:01,704 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201293deae5632d4077ba8955722e06df43 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201293deae5632d4077ba8955722e06df43 2023-02-09 16:55:02,113 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/.tmp/family1/bead1a970a3848f49f62ba2f97d0762b 2023-02-09 16:55:02,117 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/.tmp/family1/bead1a970a3848f49f62ba2f97d0762b as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/bead1a970a3848f49f62ba2f97d0762b 2023-02-09 16:55:02,121 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/bead1a970a3848f49f62ba2f97d0762b, entries=1, sequenceid=13, filesize=5.0 K 2023-02-09 16:55:02,122 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 598aece21dfd9476b532637bf96ec2b2 in 431ms, sequenceid=13, compaction requested=true 2023-02-09 16:55:02,122 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 598aece21dfd9476b532637bf96ec2b2: 2023-02-09 16:55:02,122 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2. 2023-02-09 16:55:02,122 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 16:55:02,122 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 16:55:02,122 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:02,122 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-09 16:55:02,122 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-09 16:55:02,124 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:02,124 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:02,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:02,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:55:02,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:55:02,124 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:02,124 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:55:02,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:55:02,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:55:02,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:02,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:02,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:55:02,125 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-09 16:55:02,125 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@738db889[Count = 0] remaining members to acquire global barrier 2023-02-09 16:55:02,125 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-09 16:55:02,125 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:02,126 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:02,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:02,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:02,126 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-09 16:55:02,126 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-09 16:55:02,126 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:55:02,126 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:02,126 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:55:02,129 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-09 16:55:02,129 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:02,129 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:55:02,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:02,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:55:02,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:55:02,129 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-09 16:55:02,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:55:02,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:55:02,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:02,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:02,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:55:02,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:02,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:02,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:55:02,131 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-09 16:55:02,131 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-09 16:55:02,131 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:55:02,131 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:55:02,131 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:02,131 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:55:02,132 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:02,132 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:02,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:02,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:55:02,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:55:02,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:02,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:02,133 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:55:02,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:55:02,133 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:02,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:55:02,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:55:02,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:02,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:02,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:55:02,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:02,134 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:02,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:02,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:55:02,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:02,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:02,136 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:55:02,136 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:02,136 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:55:02,136 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:02,136 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:55:02,136 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:55:02,136 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-09 16:55:02,136 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:55:02,136 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:02,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:55:02,137 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:02,137 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:02,137 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:02,137 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:02,137 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-09 16:55:02,137 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:55:02,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:55:02,137 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:55:02,237 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:55:02,237 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:02,237 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:02,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:55:02,241 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:02,241 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:02,242 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:55:02,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-09 16:55:02,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:02,243 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-09 16:55:02,244 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:55:02,244 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-09 16:55:02,244 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-09 16:55:02,244 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:02,244 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:02,245 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:02,245 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:55:02,245 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:55:02,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:55:02,246 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:02,246 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:55:02,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:02,246 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:02,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:55:02,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:02,246 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:02,247 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-09 16:55:02,247 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:02,247 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-09 16:55:02,247 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:55:02,247 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-09 16:55:02,247 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 16:55:02,247 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:55:02,247 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2. 2023-02-09 16:55:02,247 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2. started... 2023-02-09 16:55:02,247 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 598aece21dfd9476b532637bf96ec2b2 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 16:55:02,658 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512059623313340b5414c91100157453a211a to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512059623313340b5414c91100157453a211a 2023-02-09 16:55:03,064 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/.tmp/family1/984fd69ac09c495bb87def89d3299a49 2023-02-09 16:55:03,068 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/.tmp/family1/984fd69ac09c495bb87def89d3299a49 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/984fd69ac09c495bb87def89d3299a49 2023-02-09 16:55:03,072 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/984fd69ac09c495bb87def89d3299a49, entries=1, sequenceid=17, filesize=5.0 K 2023-02-09 16:55:03,073 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 598aece21dfd9476b532637bf96ec2b2 in 826ms, sequenceid=17, compaction requested=true 2023-02-09 16:55:03,073 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 598aece21dfd9476b532637bf96ec2b2: 2023-02-09 16:55:03,073 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2. 2023-02-09 16:55:03,073 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 16:55:03,073 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 16:55:03,073 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:03,073 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-09 16:55:03,074 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-09 16:55:03,079 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:03,079 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:03,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:03,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:55:03,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:55:03,079 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:03,079 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:55:03,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:55:03,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:55:03,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:03,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:03,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:55:03,080 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-09 16:55:03,080 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@15004f9[Count = 0] remaining members to acquire global barrier 2023-02-09 16:55:03,080 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-09 16:55:03,081 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:03,082 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:03,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:03,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:03,082 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-09 16:55:03,082 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-09 16:55:03,082 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:03,082 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:55:03,082 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:55:03,083 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:03,083 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-09 16:55:03,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:03,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:55:03,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:55:03,083 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:55:03,083 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-09 16:55:03,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:55:03,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:55:03,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:03,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:03,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:55:03,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:03,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:03,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:55:03,085 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-09 16:55:03,085 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-09 16:55:03,085 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:55:03,085 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:55:03,085 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:03,085 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:55:03,088 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:03,088 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:03,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:03,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:55:03,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:55:03,088 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:03,088 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:55:03,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:03,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:55:03,088 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:03,088 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:55:03,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:55:03,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:03,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:03,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:55:03,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:03,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:03,089 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:03,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:55:03,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:03,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:03,092 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:03,092 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:03,092 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:03,092 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:55:03,092 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:03,092 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:55:03,092 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-09 16:55:03,092 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:55:03,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:55:03,092 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:55:03,092 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:03,092 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:55:03,092 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:03,092 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:03,092 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-09 16:55:03,092 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:55:03,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:55:03,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:55:03,193 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:55:03,193 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:03,193 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:03,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:55:03,197 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:03,197 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:03,197 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:55:03,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-09 16:55:03,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:03,199 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-09 16:55:03,199 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:55:03,199 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-09 16:55:03,199 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-09 16:55:03,199 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:03,199 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:03,201 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:03,201 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:55:03,201 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:55:03,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:55:03,201 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:03,201 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:55:03,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:03,201 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:03,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:55:03,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:03,202 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:03,202 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-09 16:55:03,202 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:03,202 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-09 16:55:03,202 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:55:03,202 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-09 16:55:03,202 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 16:55:03,202 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:55:03,202 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2. 2023-02-09 16:55:03,202 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2. started... 2023-02-09 16:55:03,203 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 598aece21dfd9476b532637bf96ec2b2 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 16:55:03,615 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512284b2309218d41498b9c7e0334a42fca6e to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512284b2309218d41498b9c7e0334a42fca6e 2023-02-09 16:55:04,021 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/.tmp/family1/11ecbdfbf0f4452db1d91771a0f1257f 2023-02-09 16:55:04,026 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/.tmp/family1/11ecbdfbf0f4452db1d91771a0f1257f as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/11ecbdfbf0f4452db1d91771a0f1257f 2023-02-09 16:55:04,030 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/11ecbdfbf0f4452db1d91771a0f1257f, entries=1, sequenceid=21, filesize=5.0 K 2023-02-09 16:55:04,031 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 598aece21dfd9476b532637bf96ec2b2 in 828ms, sequenceid=21, compaction requested=true 2023-02-09 16:55:04,032 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 598aece21dfd9476b532637bf96ec2b2: 2023-02-09 16:55:04,032 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2. 2023-02-09 16:55:04,032 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 16:55:04,032 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 16:55:04,032 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:04,032 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-09 16:55:04,032 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-09 16:55:04,033 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:04,033 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:04,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:04,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:55:04,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:55:04,034 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:04,034 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:55:04,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:55:04,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:55:04,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:04,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:04,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:55:04,035 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-09 16:55:04,035 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6dcec94b[Count = 0] remaining members to acquire global barrier 2023-02-09 16:55:04,035 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-09 16:55:04,035 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:04,037 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:04,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:04,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:04,038 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-09 16:55:04,038 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-09 16:55:04,038 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:04,038 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:55:04,038 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:55:04,039 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:04,039 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-09 16:55:04,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:04,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:55:04,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:55:04,039 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:55:04,039 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-09 16:55:04,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:55:04,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:55:04,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:04,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:04,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:55:04,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:04,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:04,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:55:04,042 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-09 16:55:04,042 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-09 16:55:04,042 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:55:04,042 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:55:04,042 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:04,042 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:55:04,043 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:04,043 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:04,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:04,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:55:04,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:55:04,043 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:04,043 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:55:04,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:04,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:55:04,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:55:04,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:55:04,044 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:04,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:04,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:04,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:55:04,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:04,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:04,045 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:04,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:55:04,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:04,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:04,048 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:04,048 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:55:04,048 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:04,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:55:04,048 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:04,048 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-09 16:55:04,048 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:55:04,048 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:55:04,048 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-09 16:55:04,048 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:04,048 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:55:04,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:55:04,048 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:04,048 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:04,048 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:04,048 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-09 16:55:04,048 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:55:04,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:55:04,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:55:04,148 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:55:04,149 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:04,149 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:04,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:55:04,153 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:04,153 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:04,153 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:55:04,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-09 16:55:04,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:04,155 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-09 16:55:04,155 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:55:04,155 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-09 16:55:04,155 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-09 16:55:04,156 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:04,156 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:04,158 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:04,158 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:55:04,158 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:55:04,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:55:04,158 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:04,158 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:55:04,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:04,158 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:04,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:55:04,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:04,159 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:04,159 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-09 16:55:04,159 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:04,159 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-09 16:55:04,159 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:55:04,159 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-09 16:55:04,159 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 16:55:04,159 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:55:04,159 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2. 2023-02-09 16:55:04,159 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2. started... 2023-02-09 16:55:04,159 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 598aece21dfd9476b532637bf96ec2b2 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 16:55:04,572 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512316b34b8c23d1b45d7bb1e9d9f5fc15124 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512316b34b8c23d1b45d7bb1e9d9f5fc15124 2023-02-09 16:55:04,977 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/.tmp/family1/af4560d90be845fe8a67ed0006b147c1 2023-02-09 16:55:04,982 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/.tmp/family1/af4560d90be845fe8a67ed0006b147c1 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/af4560d90be845fe8a67ed0006b147c1 2023-02-09 16:55:04,986 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/af4560d90be845fe8a67ed0006b147c1, entries=1, sequenceid=25, filesize=5.0 K 2023-02-09 16:55:04,986 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 598aece21dfd9476b532637bf96ec2b2 in 827ms, sequenceid=25, compaction requested=true 2023-02-09 16:55:04,987 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 598aece21dfd9476b532637bf96ec2b2: 2023-02-09 16:55:04,987 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2. 2023-02-09 16:55:04,987 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 16:55:04,987 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 16:55:04,987 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:04,987 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-09 16:55:04,987 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-09 16:55:04,988 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:04,988 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:04,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:04,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:55:04,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:55:04,989 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:04,989 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:55:04,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:55:04,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:55:04,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:04,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:04,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:55:04,990 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-09 16:55:04,990 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3f3d6209[Count = 0] remaining members to acquire global barrier 2023-02-09 16:55:04,990 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-09 16:55:04,990 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:04,991 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:04,991 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:04,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:04,991 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-09 16:55:04,991 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-09 16:55:04,991 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:55:04,991 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:04,991 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:55:04,992 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-09 16:55:04,993 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:04,993 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:55:04,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:04,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:55:04,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:55:04,993 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-09 16:55:04,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:55:04,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:55:04,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:04,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:04,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:55:04,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:04,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:04,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:55:04,995 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-09 16:55:04,995 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-09 16:55:04,995 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:55:04,995 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:55:04,995 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:04,995 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:55:04,998 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:04,998 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:04,998 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:55:04,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:04,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:55:04,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:55:04,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:04,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:04,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:55:04,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:55:04,998 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:04,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:55:04,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:04,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:04,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:55:04,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:04,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:04,999 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:04,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:55:05,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:05,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:05,004 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:55:05,004 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:05,004 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:55:05,004 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:05,004 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-09 16:55:05,004 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:55:05,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:55:05,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:55:05,004 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:55:05,004 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:05,004 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:05,004 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:05,004 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:05,004 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-09 16:55:05,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:55:05,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:55:05,004 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:05,004 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:55:05,104 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:55:05,105 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:05,105 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:05,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:55:05,109 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:05,109 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:05,109 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:55:05,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-09 16:55:05,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:05,111 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-09 16:55:05,111 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:55:05,111 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-09 16:55:05,111 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-09 16:55:05,111 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:05,111 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:05,115 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:55:05,115 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:05,115 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:55:05,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:55:05,115 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:05,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:05,115 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:55:05,116 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:05,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:55:05,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:05,116 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:05,116 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-09 16:55:05,116 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:05,116 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-09 16:55:05,116 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:55:05,116 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-09 16:55:05,117 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 16:55:05,117 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:55:05,117 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2. 2023-02-09 16:55:05,117 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2. started... 2023-02-09 16:55:05,117 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 598aece21dfd9476b532637bf96ec2b2 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 16:55:05,528 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101634099bae0c64e1c9c97b6fbecd9fba9 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101634099bae0c64e1c9c97b6fbecd9fba9 2023-02-09 16:55:05,933 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/.tmp/family1/bc63949c506648fda18b5a8924bd9099 2023-02-09 16:55:05,937 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/.tmp/family1/bc63949c506648fda18b5a8924bd9099 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/bc63949c506648fda18b5a8924bd9099 2023-02-09 16:55:05,941 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/bc63949c506648fda18b5a8924bd9099, entries=1, sequenceid=29, filesize=5.0 K 2023-02-09 16:55:05,941 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 598aece21dfd9476b532637bf96ec2b2 in 824ms, sequenceid=29, compaction requested=true 2023-02-09 16:55:05,942 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 598aece21dfd9476b532637bf96ec2b2: 2023-02-09 16:55:05,942 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2. 2023-02-09 16:55:05,942 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 16:55:05,942 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 16:55:05,942 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:05,942 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-09 16:55:05,942 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-09 16:55:05,943 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:05,943 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:05,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:05,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:55:05,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:55:05,944 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:05,944 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:55:05,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:55:05,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:55:05,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:05,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:05,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:55:05,945 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-09 16:55:05,945 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@21eadc97[Count = 0] remaining members to acquire global barrier 2023-02-09 16:55:05,945 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-09 16:55:05,945 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:05,946 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:05,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:05,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:05,946 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-09 16:55:05,946 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-09 16:55:05,946 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:55:05,946 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:05,946 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:55:05,952 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-09 16:55:05,952 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:05,952 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:55:05,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:05,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:55:05,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:55:05,952 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-09 16:55:05,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:55:05,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:55:05,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:05,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:05,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:55:05,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:05,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:05,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:55:05,954 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-09 16:55:05,954 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-09 16:55:05,954 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:55:05,954 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:55:05,954 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:05,954 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:55:05,955 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:05,955 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:05,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:05,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:55:05,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:55:05,955 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:05,955 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:55:05,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:05,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:55:05,956 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:05,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:55:05,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:55:05,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:05,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:05,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:55:05,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:05,957 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:05,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:05,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:55:05,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:05,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:05,959 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:05,959 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:05,959 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:55:05,959 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:05,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:55:05,959 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-09 16:55:05,959 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:55:05,959 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:55:05,959 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:05,959 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:55:05,959 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:05,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:55:05,959 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:05,959 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:05,959 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-09 16:55:05,959 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-09 16:55:05,959 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:55:05,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:55:05,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:55:06,059 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:55:06,060 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:06,060 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:06,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:55:06,064 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:06,064 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:06,064 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:55:06,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-09 16:55:06,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:06,066 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-09 16:55:06,066 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:55:06,066 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-09 16:55:06,066 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-09 16:55:06,066 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:06,066 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:06,068 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:55:06,068 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:06,068 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:55:06,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:55:06,068 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:06,068 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:55:06,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:06,069 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:06,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:55:06,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:06,069 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:06,069 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-09 16:55:06,069 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:06,069 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-09 16:55:06,069 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:55:06,069 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-09 16:55:06,069 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 16:55:06,069 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:55:06,069 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2. 2023-02-09 16:55:06,070 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2. started... 2023-02-09 16:55:06,070 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 598aece21dfd9476b532637bf96ec2b2 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 16:55:06,487 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010382822a3785644e3cbaffef17c705a852 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010382822a3785644e3cbaffef17c705a852 2023-02-09 16:55:06,893 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/.tmp/family1/e678c8c0ab8949bc84ec6b38e75c3987 2023-02-09 16:55:06,898 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/.tmp/family1/e678c8c0ab8949bc84ec6b38e75c3987 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/e678c8c0ab8949bc84ec6b38e75c3987 2023-02-09 16:55:06,901 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/e678c8c0ab8949bc84ec6b38e75c3987, entries=1, sequenceid=33, filesize=5.0 K 2023-02-09 16:55:06,902 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 598aece21dfd9476b532637bf96ec2b2 in 832ms, sequenceid=33, compaction requested=true 2023-02-09 16:55:06,902 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 598aece21dfd9476b532637bf96ec2b2: 2023-02-09 16:55:06,902 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2. 2023-02-09 16:55:06,902 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 16:55:06,902 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 16:55:06,902 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:06,902 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-09 16:55:06,902 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-09 16:55:06,904 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:06,904 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:06,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:06,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:55:06,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:55:06,904 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:06,904 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:55:06,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:55:06,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:55:06,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:06,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:06,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:55:06,905 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-09 16:55:06,905 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@201c739f[Count = 0] remaining members to acquire global barrier 2023-02-09 16:55:06,905 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-09 16:55:06,905 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:06,906 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:06,906 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:06,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:06,907 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-09 16:55:06,907 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-09 16:55:06,907 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:06,907 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:55:06,907 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:55:06,908 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-09 16:55:06,908 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:55:06,908 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:06,908 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-09 16:55:06,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:06,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:55:06,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:55:06,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:55:06,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:55:06,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:06,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:06,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:55:06,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:06,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:06,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:55:06,910 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-09 16:55:06,910 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-09 16:55:06,910 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:55:06,910 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:55:06,910 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:06,910 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:55:06,912 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:06,912 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:06,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:06,913 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:55:06,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:55:06,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:55:06,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:06,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:06,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:55:06,913 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:06,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:55:06,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:55:06,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:06,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:06,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:55:06,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:06,914 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:06,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:06,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:55:06,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:06,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:06,916 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:06,916 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:06,916 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:55:06,916 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:06,916 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:55:06,916 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:55:06,916 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:55:06,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:55:06,916 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-09 16:55:06,916 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:55:06,916 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:06,916 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:06,916 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:06,916 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:06,916 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-09 16:55:06,916 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:55:06,916 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:55:06,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:55:07,017 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:55:07,017 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:07,017 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:07,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:55:07,022 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:07,022 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:07,022 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:55:07,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-09 16:55:07,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:07,024 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-09 16:55:07,025 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:55:07,025 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-09 16:55:07,025 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-09 16:55:07,025 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:07,025 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:07,026 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:55:07,027 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:07,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:55:07,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:55:07,027 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:07,027 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:55:07,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:07,027 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:07,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:55:07,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:07,028 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:07,028 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-09 16:55:07,028 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:07,028 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-09 16:55:07,028 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:55:07,028 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-09 16:55:07,028 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 16:55:07,028 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:55:07,028 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2. 2023-02-09 16:55:07,029 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2. started... 2023-02-09 16:55:07,029 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 598aece21dfd9476b532637bf96ec2b2 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 16:55:07,447 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509076544a2c94d6a4cd9902263448aa62cb6 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201509076544a2c94d6a4cd9902263448aa62cb6 2023-02-09 16:55:07,854 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/.tmp/family1/aeb33d0c0ef64897902966a067794a22 2023-02-09 16:55:07,858 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/.tmp/family1/aeb33d0c0ef64897902966a067794a22 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/aeb33d0c0ef64897902966a067794a22 2023-02-09 16:55:07,861 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/aeb33d0c0ef64897902966a067794a22, entries=1, sequenceid=37, filesize=5.0 K 2023-02-09 16:55:07,862 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 598aece21dfd9476b532637bf96ec2b2 in 833ms, sequenceid=37, compaction requested=true 2023-02-09 16:55:07,862 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 598aece21dfd9476b532637bf96ec2b2: 2023-02-09 16:55:07,862 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2. 2023-02-09 16:55:07,862 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 16:55:07,862 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 16:55:07,862 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:07,862 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-09 16:55:07,862 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-09 16:55:07,864 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:07,864 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:07,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:07,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:55:07,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:55:07,865 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:07,865 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:55:07,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:55:07,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:55:07,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:07,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:07,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:55:07,866 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-09 16:55:07,866 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3b036246[Count = 0] remaining members to acquire global barrier 2023-02-09 16:55:07,866 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-09 16:55:07,866 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:07,867 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:07,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:07,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:07,867 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-09 16:55:07,867 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-09 16:55:07,867 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:55:07,867 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:07,867 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:55:07,868 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:07,868 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-09 16:55:07,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:07,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:55:07,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:55:07,868 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:55:07,869 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-09 16:55:07,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:55:07,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:55:07,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:07,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:07,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:55:07,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:07,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:07,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:55:07,870 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-09 16:55:07,870 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-09 16:55:07,870 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:55:07,870 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:55:07,870 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:07,870 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:55:07,872 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:07,872 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:07,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:07,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:07,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:55:07,872 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:55:07,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:55:07,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:07,872 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:07,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:55:07,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:55:07,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:55:07,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:07,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:07,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:55:07,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:07,873 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:07,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:07,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:55:07,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:07,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:07,876 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:07,876 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:55:07,876 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:07,876 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:55:07,876 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-09 16:55:07,876 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:55:07,876 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-09 16:55:07,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:55:07,876 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:55:07,876 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:07,876 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:55:07,876 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:07,876 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:07,876 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-09 16:55:07,876 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:55:07,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:55:07,876 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:07,876 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:55:07,876 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:07,977 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:55:07,977 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:07,977 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:07,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:55:07,981 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:07,981 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:07,981 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:55:07,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-09 16:55:07,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:07,983 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-09 16:55:07,983 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:55:07,983 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-09 16:55:07,983 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-09 16:55:07,983 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:07,983 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:07,984 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:07,985 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:55:07,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:55:07,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:55:07,985 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:07,985 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:55:07,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:07,985 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:07,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:55:07,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:07,986 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:07,986 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-09 16:55:07,986 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:07,986 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-09 16:55:07,986 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:55:07,986 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-09 16:55:07,986 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 16:55:07,986 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:55:07,986 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2. 2023-02-09 16:55:07,986 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2. started... 2023-02-09 16:55:07,986 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 598aece21dfd9476b532637bf96ec2b2 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 16:55:08,398 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511205233a27109934b6b941493326937d93d to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511205233a27109934b6b941493326937d93d 2023-02-09 16:55:08,803 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/.tmp/family1/f5077655016c4699b5ea93ef54b03610 2023-02-09 16:55:08,807 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/.tmp/family1/f5077655016c4699b5ea93ef54b03610 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/f5077655016c4699b5ea93ef54b03610 2023-02-09 16:55:08,811 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/f5077655016c4699b5ea93ef54b03610, entries=1, sequenceid=41, filesize=5.0 K 2023-02-09 16:55:08,811 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 598aece21dfd9476b532637bf96ec2b2 in 825ms, sequenceid=41, compaction requested=true 2023-02-09 16:55:08,812 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 598aece21dfd9476b532637bf96ec2b2: 2023-02-09 16:55:08,812 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2. 2023-02-09 16:55:08,812 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 16:55:08,812 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 16:55:08,812 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:08,812 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-09 16:55:08,812 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-09 16:55:08,813 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:08,813 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:08,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:08,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:55:08,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:55:08,814 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:08,814 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:55:08,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:55:08,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:55:08,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:08,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:08,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:55:08,815 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-09 16:55:08,815 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6ffa7205[Count = 0] remaining members to acquire global barrier 2023-02-09 16:55:08,815 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-09 16:55:08,815 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:08,816 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:08,816 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:08,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:08,816 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-09 16:55:08,816 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-09 16:55:08,816 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:55:08,816 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:08,817 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:55:08,818 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-09 16:55:08,818 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:08,818 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:55:08,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:08,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:55:08,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:55:08,819 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-09 16:55:08,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:55:08,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:55:08,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:08,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:08,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:55:08,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:08,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:08,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:55:08,820 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-09 16:55:08,820 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-09 16:55:08,821 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:55:08,821 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:55:08,821 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:08,821 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:55:08,822 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:08,822 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:08,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:08,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:55:08,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:55:08,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:08,822 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:55:08,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:08,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:55:08,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:55:08,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:55:08,823 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:08,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:08,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:08,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:55:08,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:08,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:08,823 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:08,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:55:08,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:08,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:08,826 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:08,826 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:55:08,826 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:08,826 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:55:08,826 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-09 16:55:08,826 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:55:08,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:55:08,826 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:55:08,826 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:08,826 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:55:08,826 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:08,826 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:08,826 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-09 16:55:08,826 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:55:08,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:55:08,826 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:08,826 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:55:08,826 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:08,926 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:55:08,927 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:08,927 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:08,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:55:08,928 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41333] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:08,930 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] procedure2.ProcedureExecutor(1029): Stored pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-09 16:55:08,931 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-09 16:55:08,931 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 16:55:08,931 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=58, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675962308931 2023-02-09 16:55:08,933 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-09 16:55:08,934 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-02-09 16:55:08,934 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-09 16:55:08,934 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] zookeeper.ReadOnlyZKClient(139): Connect 0x77fce872 to 127.0.0.1:53887 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 16:55:08,939 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@17a58846, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 16:55:08,939 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-09 16:55:09,773 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601037ddcf377a59f45ac885864309e6a27c6 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601037ddcf377a59f45ac885864309e6a27c6 2023-02-09 16:55:09,774 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-09 16:55:09,786 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 16:55:09,787 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58612, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 16:55:09,793 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:09,793 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:09,793 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-09 16:55:09,794 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41354, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-09 16:55:09,802 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/056906335c394bd481f45fdb4cf226a1 first=Optional[r3] last=Optional[r6] 2023-02-09 16:55:09,802 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2., hostname=jenkins-hbase4.apache.org,35511,1675961620699, seqNum=2 for row with hfile group [{family1,hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/056906335c394bd481f45fdb4cf226a1}] 2023-02-09 16:55:09,806 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(763): Validating hfile at hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/056906335c394bd481f45fdb4cf226a1 for inclusion in 598aece21dfd9476b532637bf96ec2b2/family1 2023-02-09 16:55:09,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-02-09 16:55:09,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(777): Region bounds: first= last= 2023-02-09 16:55:09,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HRegion(2445): Flush status journal for 598aece21dfd9476b532637bf96ec2b2: 2023-02-09 16:55:09,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/056906335c394bd481f45fdb4cf226a1 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__ts98kompfao4qfg4d5icqebq26ptgts6jp8pd7oot989nvab5f8sl2q09kbccjka/family1/056906335c394bd481f45fdb4cf226a1 2023-02-09 16:55:09,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__ts98kompfao4qfg4d5icqebq26ptgts6jp8pd7oot989nvab5f8sl2q09kbccjka/family1/056906335c394bd481f45fdb4cf226a1 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/21f88535b01e4967a74e822d98047012_SeqId_44_ 2023-02-09 16:55:09,811 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(849): Loaded HFile hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__ts98kompfao4qfg4d5icqebq26ptgts6jp8pd7oot989nvab5f8sl2q09kbccjka/family1/056906335c394bd481f45fdb4cf226a1 into 598aece21dfd9476b532637bf96ec2b2/family1 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/21f88535b01e4967a74e822d98047012_SeqId_44_ - updating store file list. 2023-02-09 16:55:09,815 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(882): Loaded HFile hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/21f88535b01e4967a74e822d98047012_SeqId_44_ into 598aece21dfd9476b532637bf96ec2b2/family1 2023-02-09 16:55:09,815 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(855): Successfully loaded hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__ts98kompfao4qfg4d5icqebq26ptgts6jp8pd7oot989nvab5f8sl2q09kbccjka/family1/056906335c394bd481f45fdb4cf226a1 into 598aece21dfd9476b532637bf96ec2b2/family1 (new location: hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/21f88535b01e4967a74e822d98047012_SeqId_44_) 2023-02-09 16:55:09,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__ts98kompfao4qfg4d5icqebq26ptgts6jp8pd7oot989nvab5f8sl2q09kbccjka/family1/056906335c394bd481f45fdb4cf226a1 2023-02-09 16:55:09,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-09 16:55:09,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51552 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-09 16:55:09,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(1912): 598aece21dfd9476b532637bf96ec2b2/family1 is initiating minor compaction 2023-02-09 16:55:09,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@2d8cf16d; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 16:55:09,818 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 598aece21dfd9476b532637bf96ec2b2/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2. 2023-02-09 16:55:09,818 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/0639c3c836e449cd829665a166789976, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/bead1a970a3848f49f62ba2f97d0762b, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/984fd69ac09c495bb87def89d3299a49, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/11ecbdfbf0f4452db1d91771a0f1257f, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/af4560d90be845fe8a67ed0006b147c1, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/bc63949c506648fda18b5a8924bd9099, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/e678c8c0ab8949bc84ec6b38e75c3987, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/aeb33d0c0ef64897902966a067794a22, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/f5077655016c4699b5ea93ef54b03610, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/21f88535b01e4967a74e822d98047012_SeqId_44_] into tmpdir=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/.tmp, totalSize=50.3 K 2023-02-09 16:55:09,818 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting 0639c3c836e449cd829665a166789976, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-09 16:55:09,818 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting bead1a970a3848f49f62ba2f97d0762b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-09 16:55:09,818 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting 984fd69ac09c495bb87def89d3299a49, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-09 16:55:09,818 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting 11ecbdfbf0f4452db1d91771a0f1257f, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-09 16:55:09,818 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting af4560d90be845fe8a67ed0006b147c1, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-09 16:55:09,818 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting bc63949c506648fda18b5a8924bd9099, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-09 16:55:09,818 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting e678c8c0ab8949bc84ec6b38e75c3987, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-09 16:55:09,818 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting aeb33d0c0ef64897902966a067794a22, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-09 16:55:09,819 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting f5077655016c4699b5ea93ef54b03610, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-09 16:55:09,819 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting 21f88535b01e4967a74e822d98047012_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-09 16:55:09,819 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-09 16:55:09,820 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 16:55:09,822 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512284b2309218d41498b9c7e0334a42fca6e to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512284b2309218d41498b9c7e0334a42fca6e 2023-02-09 16:55:09,823 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512316b34b8c23d1b45d7bb1e9d9f5fc15124 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512316b34b8c23d1b45d7bb1e9d9f5fc15124 2023-02-09 16:55:09,824 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101634099bae0c64e1c9c97b6fbecd9fba9 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101634099bae0c64e1c9c97b6fbecd9fba9 2023-02-09 16:55:09,825 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010382822a3785644e3cbaffef17c705a852 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010382822a3785644e3cbaffef17c705a852 2023-02-09 16:55:09,825 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 4 expired mob files are deleted 2023-02-09 16:55:09,825 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-02-09 16:55:09,826 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-09 16:55:09,826 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-09 16:55:09,826 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-09 16:55:09,826 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-09 16:55:09,826 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-09 16:55:09,826 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-09 16:55:09,826 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-09 16:55:09,826 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-09 16:55:09,849 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] throttle.PressureAwareThroughputController(145): 598aece21dfd9476b532637bf96ec2b2#family1#compaction#73 average throughput is 0.32 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 16:55:10,665 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/.tmp/family1/4bb7e5b1c860432d9bb70a56cdacda17 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/4bb7e5b1c860432d9bb70a56cdacda17 2023-02-09 16:55:10,668 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205ab7e260efe124701a0eabb67e2d0ba43 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205ab7e260efe124701a0eabb67e2d0ba43 2023-02-09 16:55:10,669 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-09 16:55:10,669 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 598aece21dfd9476b532637bf96ec2b2/family1 of 598aece21dfd9476b532637bf96ec2b2 into 4bb7e5b1c860432d9bb70a56cdacda17(size=6.8 K), total size for store is 197.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-09 16:55:10,669 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 598aece21dfd9476b532637bf96ec2b2: 2023-02-09 16:55:10,669 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2., storeName=family1, fileCount=10, fileSize=50.3 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1675961709818; duration=0sec 2023-02-09 16:55:10,669 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 16:55:10,685 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:10,685 INFO [MobCompactor-pool-0] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:10,692 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/21ddb603cd7a40f0b0138cad3db4aae4 first=Optional[r00] last=Optional[r2] 2023-02-09 16:55:10,693 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2., hostname=jenkins-hbase4.apache.org,35511,1675961620699, seqNum=2 for row with hfile group [{family1,hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/21ddb603cd7a40f0b0138cad3db4aae4}] 2023-02-09 16:55:10,695 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(763): Validating hfile at hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/21ddb603cd7a40f0b0138cad3db4aae4 for inclusion in 598aece21dfd9476b532637bf96ec2b2/family1 2023-02-09 16:55:10,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-02-09 16:55:10,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(777): Region bounds: first= last= 2023-02-09 16:55:10,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HRegion(2445): Flush status journal for 598aece21dfd9476b532637bf96ec2b2: 2023-02-09 16:55:10,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/21ddb603cd7a40f0b0138cad3db4aae4 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__celav48vbd9ltf3mph9hb3s68gmej7k9kh3fsk7res7iet0lk0otl5laah48muuf/family1/21ddb603cd7a40f0b0138cad3db4aae4 2023-02-09 16:55:10,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__celav48vbd9ltf3mph9hb3s68gmej7k9kh3fsk7res7iet0lk0otl5laah48muuf/family1/21ddb603cd7a40f0b0138cad3db4aae4 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/8249d18581364062ba662d1e20091302_SeqId_47_ 2023-02-09 16:55:10,701 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(849): Loaded HFile hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__celav48vbd9ltf3mph9hb3s68gmej7k9kh3fsk7res7iet0lk0otl5laah48muuf/family1/21ddb603cd7a40f0b0138cad3db4aae4 into 598aece21dfd9476b532637bf96ec2b2/family1 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/8249d18581364062ba662d1e20091302_SeqId_47_ - updating store file list. 2023-02-09 16:55:10,704 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(882): Loaded HFile hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/8249d18581364062ba662d1e20091302_SeqId_47_ into 598aece21dfd9476b532637bf96ec2b2/family1 2023-02-09 16:55:10,704 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(855): Successfully loaded hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__celav48vbd9ltf3mph9hb3s68gmej7k9kh3fsk7res7iet0lk0otl5laah48muuf/family1/21ddb603cd7a40f0b0138cad3db4aae4 into 598aece21dfd9476b532637bf96ec2b2/family1 (new location: hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/8249d18581364062ba662d1e20091302_SeqId_47_) 2023-02-09 16:55:10,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__celav48vbd9ltf3mph9hb3s68gmej7k9kh3fsk7res7iet0lk0otl5laah48muuf/family1/21ddb603cd7a40f0b0138cad3db4aae4 2023-02-09 16:55:10,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-09 16:55:10,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 397422 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-09 16:55:10,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(1912): 598aece21dfd9476b532637bf96ec2b2/family1 is initiating minor compaction (all files) 2023-02-09 16:55:10,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@cc9954e; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 16:55:10,706 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 598aece21dfd9476b532637bf96ec2b2/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2. 2023-02-09 16:55:10,706 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/adbafb43c87246dd98e6b890da590b6b, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/4bb7e5b1c860432d9bb70a56cdacda17, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/8249d18581364062ba662d1e20091302_SeqId_47_] into tmpdir=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/.tmp, totalSize=388.1 K 2023-02-09 16:55:10,707 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting adbafb43c87246dd98e6b890da590b6b, keycount=1000, bloomtype=ROW, size=190.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878845085 2023-02-09 16:55:10,707 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting 4bb7e5b1c860432d9bb70a56cdacda17, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621245085 2023-02-09 16:55:10,708 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting 8249d18581364062ba662d1e20091302_SeqId_47_, keycount=1002, bloomtype=ROW, size=190.9 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878845085 2023-02-09 16:55:10,708 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-09 16:55:10,709 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 16:55:10,710 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130863c7a4a55e247598491ff1fc5ba627c to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130863c7a4a55e247598491ff1fc5ba627c 2023-02-09 16:55:10,711 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201293deae5632d4077ba8955722e06df43 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201293deae5632d4077ba8955722e06df43 2023-02-09 16:55:10,713 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512059623313340b5414c91100157453a211a to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512059623313340b5414c91100157453a211a 2023-02-09 16:55:10,713 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 3 expired mob files are deleted 2023-02-09 16:55:10,713 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-02-09 16:55:10,713 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-09 16:55:10,713 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-09 16:55:10,713 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 16:55:10,714 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=58, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-09 16:55:10,716 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=58, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 1.7860 sec 2023-02-09 16:55:10,722 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] throttle.PressureAwareThroughputController(145): 598aece21dfd9476b532637bf96ec2b2#family1#compaction#74 average throughput is 35.93 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 16:55:10,758 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/0639c3c836e449cd829665a166789976, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/bead1a970a3848f49f62ba2f97d0762b, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/984fd69ac09c495bb87def89d3299a49, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/11ecbdfbf0f4452db1d91771a0f1257f, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/af4560d90be845fe8a67ed0006b147c1, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/bc63949c506648fda18b5a8924bd9099, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/e678c8c0ab8949bc84ec6b38e75c3987, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/aeb33d0c0ef64897902966a067794a22, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/f5077655016c4699b5ea93ef54b03610, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/21f88535b01e4967a74e822d98047012_SeqId_44_] to archive 2023-02-09 16:55:10,759 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 16:55:10,761 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/0639c3c836e449cd829665a166789976 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/0639c3c836e449cd829665a166789976 2023-02-09 16:55:10,762 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/bead1a970a3848f49f62ba2f97d0762b to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/bead1a970a3848f49f62ba2f97d0762b 2023-02-09 16:55:10,763 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/984fd69ac09c495bb87def89d3299a49 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/984fd69ac09c495bb87def89d3299a49 2023-02-09 16:55:10,764 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/11ecbdfbf0f4452db1d91771a0f1257f to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/11ecbdfbf0f4452db1d91771a0f1257f 2023-02-09 16:55:10,766 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/af4560d90be845fe8a67ed0006b147c1 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/af4560d90be845fe8a67ed0006b147c1 2023-02-09 16:55:10,767 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/bc63949c506648fda18b5a8924bd9099 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/bc63949c506648fda18b5a8924bd9099 2023-02-09 16:55:10,768 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/e678c8c0ab8949bc84ec6b38e75c3987 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/e678c8c0ab8949bc84ec6b38e75c3987 2023-02-09 16:55:10,769 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/aeb33d0c0ef64897902966a067794a22 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/aeb33d0c0ef64897902966a067794a22 2023-02-09 16:55:10,770 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/f5077655016c4699b5ea93ef54b03610 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/f5077655016c4699b5ea93ef54b03610 2023-02-09 16:55:10,771 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/21f88535b01e4967a74e822d98047012_SeqId_44_ to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/21f88535b01e4967a74e822d98047012_SeqId_44_ 2023-02-09 16:55:10,779 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:10,779 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:10,781 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.HMaster$12(2441): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-02-09 16:55:10,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure2.ProcedureExecutor(1029): Stored pid=59, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:11,189 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-02-09 16:55:11,190 DEBUG [PEWorker-3] util.FSTableDescriptors(519): Deleted hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-02-09 16:55:11,190 INFO [PEWorker-3] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-02-09 16:55:11,192 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-02-09 16:55:11,194 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=598aece21dfd9476b532637bf96ec2b2, REOPEN/MOVE}] 2023-02-09 16:55:11,195 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=598aece21dfd9476b532637bf96ec2b2, REOPEN/MOVE 2023-02-09 16:55:11,196 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=598aece21dfd9476b532637bf96ec2b2, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:11,196 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1675961711196"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675961711196"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675961711196"}]},"ts":"1675961711196"} 2023-02-09 16:55:11,197 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=62, ppid=61, state=RUNNABLE; CloseRegionProcedure 598aece21dfd9476b532637bf96ec2b2, server=jenkins-hbase4.apache.org,35511,1675961620699}] 2023-02-09 16:55:11,349 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 598aece21dfd9476b532637bf96ec2b2 2023-02-09 16:55:11,349 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 598aece21dfd9476b532637bf96ec2b2, disabling compactions & flushes 2023-02-09 16:55:11,349 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1857): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2. 2023-02-09 16:55:11,937 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/.tmp/family1/4aa45d8e8c57410ab6b557549d87c1b2 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/4aa45d8e8c57410ab6b557549d87c1b2 2023-02-09 16:55:11,941 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 598aece21dfd9476b532637bf96ec2b2/family1 of 598aece21dfd9476b532637bf96ec2b2 into 4aa45d8e8c57410ab6b557549d87c1b2(size=192.0 K), total size for store is 192.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-09 16:55:11,941 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 598aece21dfd9476b532637bf96ec2b2: 2023-02-09 16:55:11,941 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2. 2023-02-09 16:55:11,941 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2. 2023-02-09 16:55:11,941 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2., storeName=family1, fileCount=3, fileSize=388.1 K (190.5 K, 6.8 K, 190.9 K), priority=2, time=1675961710706; duration=1sec 2023-02-09 16:55:11,941 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2. after waiting 0 ms 2023-02-09 16:55:11,942 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2. 2023-02-09 16:55:11,942 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 16:55:11,944 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/adbafb43c87246dd98e6b890da590b6b, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/4bb7e5b1c860432d9bb70a56cdacda17, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/8249d18581364062ba662d1e20091302_SeqId_47_] to archive 2023-02-09 16:55:11,945 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 16:55:11,946 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/adbafb43c87246dd98e6b890da590b6b to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/adbafb43c87246dd98e6b890da590b6b 2023-02-09 16:55:11,947 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/4bb7e5b1c860432d9bb70a56cdacda17 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/4bb7e5b1c860432d9bb70a56cdacda17 2023-02-09 16:55:11,948 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/8249d18581364062ba662d1e20091302_SeqId_47_ to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/8249d18581364062ba662d1e20091302_SeqId_47_ 2023-02-09 16:55:11,952 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-02-09 16:55:11,953 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2. 2023-02-09 16:55:11,953 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 598aece21dfd9476b532637bf96ec2b2: Waiting for close lock at 1675961711349Running coprocessor pre-close hooks at 1675961711349Disabling compacts and flushes for region at 1675961711349Disabling writes for close at 1675961711941 (+592 ms)Writing region close event to WAL at 1675961711950 (+9 ms)Running coprocessor post-close hooks at 1675961711953 (+3 ms)Closed at 1675961711953 2023-02-09 16:55:11,953 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 598aece21dfd9476b532637bf96ec2b2 to self. 2023-02-09 16:55:11,954 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 598aece21dfd9476b532637bf96ec2b2 2023-02-09 16:55:11,955 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=598aece21dfd9476b532637bf96ec2b2, regionState=CLOSED 2023-02-09 16:55:11,955 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1675961711955"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675961711955"}]},"ts":"1675961711955"} 2023-02-09 16:55:11,957 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=62, resume processing ppid=61 2023-02-09 16:55:11,957 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=62, ppid=61, state=SUCCESS; CloseRegionProcedure 598aece21dfd9476b532637bf96ec2b2, server=jenkins-hbase4.apache.org,35511,1675961620699 in 759 msec 2023-02-09 16:55:11,957 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=598aece21dfd9476b532637bf96ec2b2, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,35511,1675961620699; forceNewPlan=false, retain=true 2023-02-09 16:55:12,108 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=598aece21dfd9476b532637bf96ec2b2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:12,108 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1675961712107"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675961712107"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675961712107"}]},"ts":"1675961712107"} 2023-02-09 16:55:12,109 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=63, ppid=61, state=RUNNABLE; OpenRegionProcedure 598aece21dfd9476b532637bf96ec2b2, server=jenkins-hbase4.apache.org,35511,1675961620699}] 2023-02-09 16:55:12,263 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2. 2023-02-09 16:55:12,263 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 598aece21dfd9476b532637bf96ec2b2, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2.', STARTKEY => '', ENDKEY => ''} 2023-02-09 16:55:12,263 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 598aece21dfd9476b532637bf96ec2b2 2023-02-09 16:55:12,263 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 16:55:12,263 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 598aece21dfd9476b532637bf96ec2b2 2023-02-09 16:55:12,263 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 598aece21dfd9476b532637bf96ec2b2 2023-02-09 16:55:12,264 INFO [StoreOpener-598aece21dfd9476b532637bf96ec2b2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 598aece21dfd9476b532637bf96ec2b2 2023-02-09 16:55:12,265 DEBUG [StoreOpener-598aece21dfd9476b532637bf96ec2b2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1 2023-02-09 16:55:12,265 DEBUG [StoreOpener-598aece21dfd9476b532637bf96ec2b2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1 2023-02-09 16:55:12,266 INFO [StoreOpener-598aece21dfd9476b532637bf96ec2b2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 598aece21dfd9476b532637bf96ec2b2 columnFamilyName family1 2023-02-09 16:55:12,270 DEBUG [StoreOpener-598aece21dfd9476b532637bf96ec2b2-1] regionserver.HStore(539): loaded hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/4aa45d8e8c57410ab6b557549d87c1b2 2023-02-09 16:55:12,270 INFO [StoreOpener-598aece21dfd9476b532637bf96ec2b2-1] regionserver.HStore(310): Store=598aece21dfd9476b532637bf96ec2b2/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 16:55:12,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2 2023-02-09 16:55:12,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2 2023-02-09 16:55:12,274 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 598aece21dfd9476b532637bf96ec2b2 2023-02-09 16:55:12,274 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 598aece21dfd9476b532637bf96ec2b2; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75220025, jitterRate=0.12086571753025055}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 16:55:12,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 598aece21dfd9476b532637bf96ec2b2: Running coprocessor pre-open hook at 1675961712264Writing region info on filesystem at 1675961712264Initializing all the Stores at 1675961712264Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} at 1675961712264Cleaning up temporary data from old regions at 1675961712272 (+8 ms)Cleaning up detritus from prior splits at 1675961712272Running coprocessor post-open hooks at 1675961712275 (+3 ms)Region opened successfully at 1675961712275 2023-02-09 16:55:12,275 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2., pid=63, masterSystemTime=1675961712260 2023-02-09 16:55:12,276 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2. 2023-02-09 16:55:12,276 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2. 2023-02-09 16:55:12,277 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=598aece21dfd9476b532637bf96ec2b2, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:12,277 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1675961712277"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675961712277"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675961712277"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675961712277"}]},"ts":"1675961712277"} 2023-02-09 16:55:12,279 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=63, resume processing ppid=61 2023-02-09 16:55:12,279 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=63, ppid=61, state=SUCCESS; OpenRegionProcedure 598aece21dfd9476b532637bf96ec2b2, server=jenkins-hbase4.apache.org,35511,1675961620699 in 169 msec 2023-02-09 16:55:12,280 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=60 2023-02-09 16:55:12,280 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=60, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=598aece21dfd9476b532637bf96ec2b2, REOPEN/MOVE in 1.0850 sec 2023-02-09 16:55:12,282 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-02-09 16:55:12,282 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.0890 sec 2023-02-09 16:55:12,283 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=59, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.5010 sec 2023-02-09 16:55:12,284 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:12,284 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:12,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=59 2023-02-09 16:55:12,284 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:12,284 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:12,285 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:12,285 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:12,285 INFO [Listener at localhost/41619] compactions.TestMobCompactor(278): alter status finished 2023-02-09 16:55:12,286 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41333] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:12,287 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-09 16:55:12,288 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-09 16:55:12,288 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 16:55:12,288 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675962312288 2023-02-09 16:55:12,289 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-09 16:55:12,289 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-02-09 16:55:12,289 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-09 16:55:12,290 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] zookeeper.ReadOnlyZKClient(139): Connect 0x23cc18a3 to 127.0.0.1:53887 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 16:55:12,294 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@db0b23c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 16:55:12,294 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-09 16:55:12,294 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-09 16:55:12,295 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-09 16:55:12,295 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-09 16:55:12,295 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-09 16:55:13,118 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511280ed73f7f7f904b8280d6d0c04ea58acd to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511280ed73f7f7f904b8280d6d0c04ea58acd 2023-02-09 16:55:13,119 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-09 16:55:13,133 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 16:55:13,134 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58620, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 16:55:13,140 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:13,140 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:13,141 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-09 16:55:13,143 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41370, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-09 16:55:13,150 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/9b38c336fa124839b6e3d055e13f882e first=Optional[r05] last=Optional[r8] 2023-02-09 16:55:13,151 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2., hostname=jenkins-hbase4.apache.org,35511,1675961620699, seqNum=51 for row with hfile group [{family1,hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/9b38c336fa124839b6e3d055e13f882e}] 2023-02-09 16:55:13,155 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(763): Validating hfile at hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/9b38c336fa124839b6e3d055e13f882e for inclusion in 598aece21dfd9476b532637bf96ec2b2/family1 2023-02-09 16:55:13,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-02-09 16:55:13,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(777): Region bounds: first= last= 2023-02-09 16:55:13,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HRegion(2445): Flush status journal for 598aece21dfd9476b532637bf96ec2b2: 2023-02-09 16:55:13,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/9b38c336fa124839b6e3d055e13f882e to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__i2s9d32lbgcmu1rsam4dq90kmq65ad4u7te0shinkons26hagb60jg50pm37gjgc/family1/9b38c336fa124839b6e3d055e13f882e 2023-02-09 16:55:13,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__i2s9d32lbgcmu1rsam4dq90kmq65ad4u7te0shinkons26hagb60jg50pm37gjgc/family1/9b38c336fa124839b6e3d055e13f882e as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/550b8c3c34844203beee1e4f59f4da89_SeqId_53_ 2023-02-09 16:55:13,160 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(849): Loaded HFile hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__i2s9d32lbgcmu1rsam4dq90kmq65ad4u7te0shinkons26hagb60jg50pm37gjgc/family1/9b38c336fa124839b6e3d055e13f882e into 598aece21dfd9476b532637bf96ec2b2/family1 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/550b8c3c34844203beee1e4f59f4da89_SeqId_53_ - updating store file list. 2023-02-09 16:55:13,163 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(882): Loaded HFile hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/550b8c3c34844203beee1e4f59f4da89_SeqId_53_ into 598aece21dfd9476b532637bf96ec2b2/family1 2023-02-09 16:55:13,163 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(855): Successfully loaded hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__i2s9d32lbgcmu1rsam4dq90kmq65ad4u7te0shinkons26hagb60jg50pm37gjgc/family1/9b38c336fa124839b6e3d055e13f882e into 598aece21dfd9476b532637bf96ec2b2/family1 (new location: hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/550b8c3c34844203beee1e4f59f4da89_SeqId_53_) 2023-02-09 16:55:13,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__i2s9d32lbgcmu1rsam4dq90kmq65ad4u7te0shinkons26hagb60jg50pm37gjgc/family1/9b38c336fa124839b6e3d055e13f882e 2023-02-09 16:55:13,165 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-09 16:55:13,166 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 16:55:13,167 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511205233a27109934b6b941493326937d93d to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511205233a27109934b6b941493326937d93d 2023-02-09 16:55:13,168 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511284a04962d7ef84a659d3a6ac02e57cccf to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511284a04962d7ef84a659d3a6ac02e57cccf 2023-02-09 16:55:13,168 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2 expired mob files are deleted 2023-02-09 16:55:13,168 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-02-09 16:55:13,168 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-09 16:55:13,168 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-09 16:55:13,168 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-09 16:55:13,168 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-09 16:55:13,168 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 16:55:13,169 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-09 16:55:13,170 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 882 msec 2023-02-09 16:55:13,219 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:13,219 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:13,220 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.HMaster$12(2441): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'} 2023-02-09 16:55:13,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:13,629 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-02-09 16:55:13,630 DEBUG [PEWorker-4] util.FSTableDescriptors(519): Deleted hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-02-09 16:55:13,630 INFO [PEWorker-4] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-02-09 16:55:13,632 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=66, ppid=65, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-02-09 16:55:13,634 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=598aece21dfd9476b532637bf96ec2b2, REOPEN/MOVE}] 2023-02-09 16:55:13,635 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=598aece21dfd9476b532637bf96ec2b2, REOPEN/MOVE 2023-02-09 16:55:13,635 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=598aece21dfd9476b532637bf96ec2b2, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:13,635 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1675961713635"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675961713635"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675961713635"}]},"ts":"1675961713635"} 2023-02-09 16:55:13,637 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=68, ppid=67, state=RUNNABLE; CloseRegionProcedure 598aece21dfd9476b532637bf96ec2b2, server=jenkins-hbase4.apache.org,35511,1675961620699}] 2023-02-09 16:55:13,788 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 598aece21dfd9476b532637bf96ec2b2 2023-02-09 16:55:13,788 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 598aece21dfd9476b532637bf96ec2b2, disabling compactions & flushes 2023-02-09 16:55:13,788 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2. 2023-02-09 16:55:13,788 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2. 2023-02-09 16:55:13,788 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2. after waiting 0 ms 2023-02-09 16:55:13,789 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2. 2023-02-09 16:55:13,796 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-02-09 16:55:13,796 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2. 2023-02-09 16:55:13,796 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 598aece21dfd9476b532637bf96ec2b2: Waiting for close lock at 1675961713788Running coprocessor pre-close hooks at 1675961713788Disabling compacts and flushes for region at 1675961713788Disabling writes for close at 1675961713789 (+1 ms)Writing region close event to WAL at 1675961713793 (+4 ms)Running coprocessor post-close hooks at 1675961713796 (+3 ms)Closed at 1675961713796 2023-02-09 16:55:13,796 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 598aece21dfd9476b532637bf96ec2b2 to self. 2023-02-09 16:55:13,798 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 598aece21dfd9476b532637bf96ec2b2 2023-02-09 16:55:13,798 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=598aece21dfd9476b532637bf96ec2b2, regionState=CLOSED 2023-02-09 16:55:13,798 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1675961713798"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675961713798"}]},"ts":"1675961713798"} 2023-02-09 16:55:13,800 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=67 2023-02-09 16:55:13,800 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=67, state=SUCCESS; CloseRegionProcedure 598aece21dfd9476b532637bf96ec2b2, server=jenkins-hbase4.apache.org,35511,1675961620699 in 162 msec 2023-02-09 16:55:13,801 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=598aece21dfd9476b532637bf96ec2b2, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,35511,1675961620699; forceNewPlan=false, retain=true 2023-02-09 16:55:13,951 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=598aece21dfd9476b532637bf96ec2b2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:13,951 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1675961713951"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675961713951"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675961713951"}]},"ts":"1675961713951"} 2023-02-09 16:55:13,953 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 598aece21dfd9476b532637bf96ec2b2, server=jenkins-hbase4.apache.org,35511,1675961620699}] 2023-02-09 16:55:14,107 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2. 2023-02-09 16:55:14,107 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 598aece21dfd9476b532637bf96ec2b2, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2.', STARTKEY => '', ENDKEY => ''} 2023-02-09 16:55:14,107 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 598aece21dfd9476b532637bf96ec2b2 2023-02-09 16:55:14,107 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 16:55:14,107 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 598aece21dfd9476b532637bf96ec2b2 2023-02-09 16:55:14,107 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 598aece21dfd9476b532637bf96ec2b2 2023-02-09 16:55:14,108 INFO [StoreOpener-598aece21dfd9476b532637bf96ec2b2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 598aece21dfd9476b532637bf96ec2b2 2023-02-09 16:55:14,109 DEBUG [StoreOpener-598aece21dfd9476b532637bf96ec2b2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1 2023-02-09 16:55:14,109 DEBUG [StoreOpener-598aece21dfd9476b532637bf96ec2b2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1 2023-02-09 16:55:14,110 INFO [StoreOpener-598aece21dfd9476b532637bf96ec2b2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 598aece21dfd9476b532637bf96ec2b2 columnFamilyName family1 2023-02-09 16:55:14,114 DEBUG [StoreOpener-598aece21dfd9476b532637bf96ec2b2-1] regionserver.HStore(539): loaded hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/4aa45d8e8c57410ab6b557549d87c1b2 2023-02-09 16:55:14,118 DEBUG [StoreOpener-598aece21dfd9476b532637bf96ec2b2-1] regionserver.HStore(539): loaded hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/family1/550b8c3c34844203beee1e4f59f4da89_SeqId_53_ 2023-02-09 16:55:14,118 INFO [StoreOpener-598aece21dfd9476b532637bf96ec2b2-1] regionserver.HStore(310): Store=598aece21dfd9476b532637bf96ec2b2/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 16:55:14,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2 2023-02-09 16:55:14,120 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2 2023-02-09 16:55:14,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 598aece21dfd9476b532637bf96ec2b2 2023-02-09 16:55:14,123 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 598aece21dfd9476b532637bf96ec2b2; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71633030, jitterRate=0.06741532683372498}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 16:55:14,123 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 598aece21dfd9476b532637bf96ec2b2: Running coprocessor pre-open hook at 1675961714107Writing region info on filesystem at 1675961714107Initializing all the Stores at 1675961714108 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'} at 1675961714108Cleaning up temporary data from old regions at 1675961714120 (+12 ms)Cleaning up detritus from prior splits at 1675961714120Running coprocessor post-open hooks at 1675961714123 (+3 ms)Region opened successfully at 1675961714123 2023-02-09 16:55:14,123 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2., pid=69, masterSystemTime=1675961714104 2023-02-09 16:55:14,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2. 2023-02-09 16:55:14,125 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2. 2023-02-09 16:55:14,125 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=598aece21dfd9476b532637bf96ec2b2, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:14,125 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1675961714125"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675961714125"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675961714125"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675961714125"}]},"ts":"1675961714125"} 2023-02-09 16:55:14,128 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-02-09 16:55:14,128 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 598aece21dfd9476b532637bf96ec2b2, server=jenkins-hbase4.apache.org,35511,1675961620699 in 173 msec 2023-02-09 16:55:14,129 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-02-09 16:55:14,129 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=598aece21dfd9476b532637bf96ec2b2, REOPEN/MOVE in 494 msec 2023-02-09 16:55:14,131 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=66, resume processing ppid=65 2023-02-09 16:55:14,131 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=66, ppid=65, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 497 msec 2023-02-09 16:55:14,132 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 910 msec 2023-02-09 16:55:14,133 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:14,133 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:14,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=65 2023-02-09 16:55:14,133 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:14,133 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:14,134 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:14,134 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:14,135 INFO [Listener at localhost/41619] compactions.TestMobCompactor(278): alter status finished 2023-02-09 16:55:14,136 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=41333] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 16:55:14,137 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] procedure2.ProcedureExecutor(1029): Stored pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-09 16:55:14,137 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-09 16:55:14,138 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 16:55:14,138 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=70, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675962314138 2023-02-09 16:55:14,139 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-09 16:55:14,139 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-02-09 16:55:14,139 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-09 16:55:14,140 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] zookeeper.ReadOnlyZKClient(139): Connect 0x522aa079 to 127.0.0.1:53887 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 16:55:14,144 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@62746e8d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 16:55:14,145 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-09 16:55:14,145 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-09 16:55:14,145 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-09 16:55:14,145 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-09 16:55:14,145 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-09 16:55:14,145 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-09 16:55:14,145 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-09 16:55:14,145 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-09 16:55:14,145 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-09 16:55:14,145 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 16:55:14,146 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=70, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-09 16:55:14,147 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=70, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 10 msec 2023-02-09 16:55:14,192 INFO [Listener at localhost/41619] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=242 (was 247), OpenFileDescriptor=618 (was 625), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=136 (was 175), ProcessCount=168 (was 168), AvailableMemoryMB=3029 (was 3100) 2023-02-09 16:55:14,205 INFO [Listener at localhost/41619] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=242, OpenFileDescriptor=618, MaxFileDescriptor=60000, SystemLoadAverage=136, ProcessCount=168, AvailableMemoryMB=3029 2023-02-09 16:55:14,206 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:14,206 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:14,207 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-02-09 16:55:14,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testGetAfterCompaction 2023-02-09 16:55:14,210 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 16:55:14,210 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testGetAfterCompaction" procId is: 71 2023-02-09 16:55:14,210 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:14,210 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:14,210 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 16:55:14,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-09 16:55:14,211 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c 2023-02-09 16:55:14,212 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c empty. 2023-02-09 16:55:14,212 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c 2023-02-09 16:55:14,212 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-02-09 16:55:14,311 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:14,311 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:14,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-09 16:55:14,512 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:14,512 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:14,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-09 16:55:14,619 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/default/testGetAfterCompaction/.tabledesc/.tableinfo.0000000001 2023-02-09 16:55:14,621 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(7671): creating {ENCODED => bf0a92ee77c54fad95d2c61c050df61c, NAME => 'testGetAfterCompaction,,1675961714207.bf0a92ee77c54fad95d2c61c050df61c.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp 2023-02-09 16:55:14,813 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:14,813 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:14,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-09 16:55:15,026 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(865): Instantiated testGetAfterCompaction,,1675961714207.bf0a92ee77c54fad95d2c61c050df61c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 16:55:15,026 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1603): Closing bf0a92ee77c54fad95d2c61c050df61c, disabling compactions & flushes 2023-02-09 16:55:15,026 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1625): Closing region testGetAfterCompaction,,1675961714207.bf0a92ee77c54fad95d2c61c050df61c. 2023-02-09 16:55:15,026 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testGetAfterCompaction,,1675961714207.bf0a92ee77c54fad95d2c61c050df61c. 2023-02-09 16:55:15,026 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1713): Acquired close lock on testGetAfterCompaction,,1675961714207.bf0a92ee77c54fad95d2c61c050df61c. after waiting 0 ms 2023-02-09 16:55:15,026 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1723): Updates disabled for region testGetAfterCompaction,,1675961714207.bf0a92ee77c54fad95d2c61c050df61c. 2023-02-09 16:55:15,026 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1837): Closed testGetAfterCompaction,,1675961714207.bf0a92ee77c54fad95d2c61c050df61c. 2023-02-09 16:55:15,026 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1557): Region close journal for bf0a92ee77c54fad95d2c61c050df61c: Waiting for close lock at 1675961715026Disabling compacts and flushes for region at 1675961715026Disabling writes for close at 1675961715026Writing region close event to WAL at 1675961715026Closed at 1675961715026 2023-02-09 16:55:15,028 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 16:55:15,029 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1675961714207.bf0a92ee77c54fad95d2c61c050df61c.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1675961715029"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675961715029"}]},"ts":"1675961715029"} 2023-02-09 16:55:15,030 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-09 16:55:15,031 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 16:55:15,031 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675961715031"}]},"ts":"1675961715031"} 2023-02-09 16:55:15,032 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLING in hbase:meta 2023-02-09 16:55:15,035 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=bf0a92ee77c54fad95d2c61c050df61c, ASSIGN}] 2023-02-09 16:55:15,037 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=bf0a92ee77c54fad95d2c61c050df61c, ASSIGN 2023-02-09 16:55:15,037 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testGetAfterCompaction, region=bf0a92ee77c54fad95d2c61c050df61c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35511,1675961620699; forceNewPlan=false, retain=false 2023-02-09 16:55:15,188 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=bf0a92ee77c54fad95d2c61c050df61c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:15,189 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1675961714207.bf0a92ee77c54fad95d2c61c050df61c.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1675961715188"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675961715188"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675961715188"}]},"ts":"1675961715188"} 2023-02-09 16:55:15,190 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=73, ppid=72, state=RUNNABLE; OpenRegionProcedure bf0a92ee77c54fad95d2c61c050df61c, server=jenkins-hbase4.apache.org,35511,1675961620699}] 2023-02-09 16:55:15,314 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:15,315 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:15,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-09 16:55:15,344 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testGetAfterCompaction,,1675961714207.bf0a92ee77c54fad95d2c61c050df61c. 2023-02-09 16:55:15,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => bf0a92ee77c54fad95d2c61c050df61c, NAME => 'testGetAfterCompaction,,1675961714207.bf0a92ee77c54fad95d2c61c050df61c.', STARTKEY => '', ENDKEY => ''} 2023-02-09 16:55:15,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro with path null and priority 1073741823 2023-02-09 16:55:15,345 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro from HTD of testGetAfterCompaction successfully. 2023-02-09 16:55:15,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testGetAfterCompaction bf0a92ee77c54fad95d2c61c050df61c 2023-02-09 16:55:15,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testGetAfterCompaction,,1675961714207.bf0a92ee77c54fad95d2c61c050df61c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 16:55:15,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for bf0a92ee77c54fad95d2c61c050df61c 2023-02-09 16:55:15,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for bf0a92ee77c54fad95d2c61c050df61c 2023-02-09 16:55:15,347 INFO [StoreOpener-bf0a92ee77c54fad95d2c61c050df61c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region bf0a92ee77c54fad95d2c61c050df61c 2023-02-09 16:55:15,348 DEBUG [StoreOpener-bf0a92ee77c54fad95d2c61c050df61c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1 2023-02-09 16:55:15,348 DEBUG [StoreOpener-bf0a92ee77c54fad95d2c61c050df61c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1 2023-02-09 16:55:15,349 INFO [StoreOpener-bf0a92ee77c54fad95d2c61c050df61c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bf0a92ee77c54fad95d2c61c050df61c columnFamilyName f1 2023-02-09 16:55:15,350 INFO [StoreOpener-bf0a92ee77c54fad95d2c61c050df61c-1] regionserver.HStore(310): Store=bf0a92ee77c54fad95d2c61c050df61c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 16:55:15,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c 2023-02-09 16:55:15,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c 2023-02-09 16:55:15,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for bf0a92ee77c54fad95d2c61c050df61c 2023-02-09 16:55:15,355 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 16:55:15,355 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened bf0a92ee77c54fad95d2c61c050df61c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60127904, jitterRate=-0.10402441024780273}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 16:55:15,355 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for bf0a92ee77c54fad95d2c61c050df61c: Running coprocessor pre-open hook at 1675961715346Writing region info on filesystem at 1675961715346Initializing all the Stores at 1675961715347 (+1 ms)Instantiating store for column family {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675961715347Cleaning up temporary data from old regions at 1675961715351 (+4 ms)Cleaning up detritus from prior splits at 1675961715352 (+1 ms)Running coprocessor post-open hooks at 1675961715355 (+3 ms)Region opened successfully at 1675961715355 2023-02-09 16:55:15,356 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testGetAfterCompaction,,1675961714207.bf0a92ee77c54fad95d2c61c050df61c., pid=73, masterSystemTime=1675961715341 2023-02-09 16:55:15,357 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testGetAfterCompaction,,1675961714207.bf0a92ee77c54fad95d2c61c050df61c. 2023-02-09 16:55:15,357 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testGetAfterCompaction,,1675961714207.bf0a92ee77c54fad95d2c61c050df61c. 2023-02-09 16:55:15,358 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=bf0a92ee77c54fad95d2c61c050df61c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:15,358 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testGetAfterCompaction,,1675961714207.bf0a92ee77c54fad95d2c61c050df61c.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1675961715357"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675961715357"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675961715357"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675961715357"}]},"ts":"1675961715357"} 2023-02-09 16:55:15,360 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=72 2023-02-09 16:55:15,360 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=72, state=SUCCESS; OpenRegionProcedure bf0a92ee77c54fad95d2c61c050df61c, server=jenkins-hbase4.apache.org,35511,1675961620699 in 169 msec 2023-02-09 16:55:15,361 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-02-09 16:55:15,361 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=bf0a92ee77c54fad95d2c61c050df61c, ASSIGN in 325 msec 2023-02-09 16:55:15,361 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 16:55:15,362 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675961715361"}]},"ts":"1675961715361"} 2023-02-09 16:55:15,363 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLED in hbase:meta 2023-02-09 16:55:15,364 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 16:55:15,365 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; CreateTableProcedure table=testGetAfterCompaction in 1.1570 sec 2023-02-09 16:55:16,316 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:16,316 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:16,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-09 16:55:16,317 INFO [Listener at localhost/41619] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testGetAfterCompaction, procId: 71 completed 2023-02-09 16:55:16,317 DEBUG [Listener at localhost/41619] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testGetAfterCompaction get assigned. Timeout = 60000ms 2023-02-09 16:55:16,319 INFO [Listener at localhost/41619] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-09 16:55:16,321 INFO [Listener at localhost/41619] hbase.HBaseTestingUtility(3484): All regions for table testGetAfterCompaction assigned to meta. Checking AM states. 2023-02-09 16:55:16,322 INFO [Listener at localhost/41619] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-09 16:55:16,322 INFO [Listener at localhost/41619] hbase.HBaseTestingUtility(3504): All regions for table testGetAfterCompaction assigned. 2023-02-09 16:55:16,326 INFO [Listener at localhost/41619] regionserver.HRegion(2744): Flushing bf0a92ee77c54fad95d2c61c050df61c 1/1 column families, dataSize=37 B heapSize=368 B 2023-02-09 16:55:16,737 INFO [Listener at localhost/41619] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230209f877818c064945638998a571c6fb27d3 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230209f877818c064945638998a571c6fb27d3 2023-02-09 16:55:17,143 INFO [Listener at localhost/41619] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/.tmp/f1/29ca96ffb556482db6d30bb134570ead 2023-02-09 16:55:17,147 DEBUG [Listener at localhost/41619] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/.tmp/f1/29ca96ffb556482db6d30bb134570ead as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/29ca96ffb556482db6d30bb134570ead 2023-02-09 16:55:17,151 INFO [Listener at localhost/41619] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/29ca96ffb556482db6d30bb134570ead, entries=1, sequenceid=5, filesize=4.9 K 2023-02-09 16:55:17,152 INFO [Listener at localhost/41619] regionserver.HRegion(2947): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for bf0a92ee77c54fad95d2c61c050df61c in 826ms, sequenceid=5, compaction requested=false 2023-02-09 16:55:17,152 DEBUG [Listener at localhost/41619] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testGetAfterCompaction' 2023-02-09 16:55:17,152 DEBUG [Listener at localhost/41619] regionserver.HRegion(2445): Flush status journal for bf0a92ee77c54fad95d2c61c050df61c: 2023-02-09 16:55:17,154 INFO [Listener at localhost/41619] regionserver.HRegion(2744): Flushing bf0a92ee77c54fad95d2c61c050df61c 1/1 column families, dataSize=37 B heapSize=368 B 2023-02-09 16:55:17,492 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-09 16:55:17,565 INFO [Listener at localhost/41619] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230209ac6eb1fa8e054889a95c98a09350e1ce to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230209ac6eb1fa8e054889a95c98a09350e1ce 2023-02-09 16:55:17,970 INFO [Listener at localhost/41619] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/.tmp/f1/fc3331746d0140eabefb70e06f4a77cd 2023-02-09 16:55:17,974 DEBUG [Listener at localhost/41619] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/.tmp/f1/fc3331746d0140eabefb70e06f4a77cd as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/fc3331746d0140eabefb70e06f4a77cd 2023-02-09 16:55:17,977 INFO [Listener at localhost/41619] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/fc3331746d0140eabefb70e06f4a77cd, entries=1, sequenceid=9, filesize=4.9 K 2023-02-09 16:55:17,978 INFO [Listener at localhost/41619] regionserver.HRegion(2947): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for bf0a92ee77c54fad95d2c61c050df61c in 824ms, sequenceid=9, compaction requested=false 2023-02-09 16:55:17,978 DEBUG [Listener at localhost/41619] regionserver.HRegion(2445): Flush status journal for bf0a92ee77c54fad95d2c61c050df61c: 2023-02-09 16:55:17,980 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=41333] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testGetAfterCompaction 2023-02-09 16:55:17,981 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] procedure2.ProcedureExecutor(1029): Stored pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-02-09 16:55:17,981 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-02-09 16:55:17,982 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] mob.MobUtils(833): start MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 16:55:17,982 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=74, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675962317982 2023-02-09 16:55:17,982 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-09 16:55:17,982 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testGetAfterCompaction' and column 'f1' 2023-02-09 16:55:17,982 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testGetAfterCompaction' column='f1' 2023-02-09 16:55:17,983 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] zookeeper.ReadOnlyZKClient(139): Connect 0x2652822b to 127.0.0.1:53887 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 16:55:17,987 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6793906a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 16:55:17,987 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230209 for table='testGetAfterCompaction' and column='f1' 2023-02-09 16:55:18,031 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/29ca96ffb556482db6d30bb134570ead; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675961717142; access_time=1675961716328; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 16:55:18,031 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/fc3331746d0140eabefb70e06f4a77cd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675961717969; access_time=1675961717156; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 16:55:18,082 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/29ca96ffb556482db6d30bb134570ead; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675961717142; access_time=1675961716328; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 16:55:18,082 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/fc3331746d0140eabefb70e06f4a77cd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675961717969; access_time=1675961717156; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 16:55:18,133 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/29ca96ffb556482db6d30bb134570ead; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675961717142; access_time=1675961716328; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 16:55:18,133 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/fc3331746d0140eabefb70e06f4a77cd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675961717969; access_time=1675961717156; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 16:55:18,183 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/29ca96ffb556482db6d30bb134570ead; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675961717142; access_time=1675961716328; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 16:55:18,184 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/fc3331746d0140eabefb70e06f4a77cd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675961717969; access_time=1675961717156; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 16:55:18,228 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-09 16:55:18,234 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/29ca96ffb556482db6d30bb134570ead; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675961717142; access_time=1675961716328; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 16:55:18,234 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/fc3331746d0140eabefb70e06f4a77cd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675961717969; access_time=1675961717156; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 16:55:18,285 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/29ca96ffb556482db6d30bb134570ead; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675961717142; access_time=1675961716328; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 16:55:18,285 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/fc3331746d0140eabefb70e06f4a77cd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675961717969; access_time=1675961717156; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 16:55:18,336 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/29ca96ffb556482db6d30bb134570ead; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675961717142; access_time=1675961716328; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 16:55:18,336 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/fc3331746d0140eabefb70e06f4a77cd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675961717969; access_time=1675961717156; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 16:55:18,387 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/29ca96ffb556482db6d30bb134570ead; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675961717142; access_time=1675961716328; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 16:55:18,387 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/fc3331746d0140eabefb70e06f4a77cd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675961717969; access_time=1675961717156; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 16:55:18,438 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/29ca96ffb556482db6d30bb134570ead; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675961717142; access_time=1675961716328; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 16:55:18,439 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/fc3331746d0140eabefb70e06f4a77cd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675961717969; access_time=1675961717156; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 16:55:18,489 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/29ca96ffb556482db6d30bb134570ead; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675961717142; access_time=1675961716328; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 16:55:18,489 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/fc3331746d0140eabefb70e06f4a77cd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675961717969; access_time=1675961717156; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 16:55:18,540 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/29ca96ffb556482db6d30bb134570ead; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675961717142; access_time=1675961716328; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 16:55:18,540 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/fc3331746d0140eabefb70e06f4a77cd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675961717969; access_time=1675961717156; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 16:55:18,591 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/29ca96ffb556482db6d30bb134570ead; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675961717142; access_time=1675961716328; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 16:55:18,591 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/fc3331746d0140eabefb70e06f4a77cd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675961717969; access_time=1675961717156; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 16:55:18,642 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/29ca96ffb556482db6d30bb134570ead; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675961717142; access_time=1675961716328; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 16:55:18,642 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/fc3331746d0140eabefb70e06f4a77cd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675961717969; access_time=1675961717156; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 16:55:18,692 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/29ca96ffb556482db6d30bb134570ead; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675961717142; access_time=1675961716328; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 16:55:18,693 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/fc3331746d0140eabefb70e06f4a77cd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675961717969; access_time=1675961717156; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 16:55:18,743 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/29ca96ffb556482db6d30bb134570ead; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675961717142; access_time=1675961716328; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 16:55:18,743 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/fc3331746d0140eabefb70e06f4a77cd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675961717969; access_time=1675961717156; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 16:55:18,794 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/29ca96ffb556482db6d30bb134570ead; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675961717142; access_time=1675961716328; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 16:55:18,794 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/fc3331746d0140eabefb70e06f4a77cd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675961717969; access_time=1675961717156; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 16:55:18,816 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230209f75104ea6f6b4378b4ef42eec5edb80d to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230209f75104ea6f6b4378b4ef42eec5edb80d 2023-02-09 16:55:18,816 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230209 table='testGetAfterCompaction' column='f1' 2023-02-09 16:55:18,829 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 16:55:18,830 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56674, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 16:55:18,835 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:18,835 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:18,836 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-09 16:55:18,837 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49056, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-09 16:55:18,845 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/29ca96ffb556482db6d30bb134570ead; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675961717142; access_time=1675961716328; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 16:55:18,845 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/fc3331746d0140eabefb70e06f4a77cd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675961717969; access_time=1675961717156; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 16:55:18,845 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230209/f1/152f5add23724cc1b427765c18431e61 first=Optional[r1] last=Optional[r2] 2023-02-09 16:55:18,846 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testGetAfterCompaction,,1675961714207.bf0a92ee77c54fad95d2c61c050df61c., hostname=jenkins-hbase4.apache.org,35511,1675961620699, seqNum=2 for row with hfile group [{f1,hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230209/f1/152f5add23724cc1b427765c18431e61}] 2023-02-09 16:55:18,849 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(763): Validating hfile at hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230209/f1/152f5add23724cc1b427765c18431e61 for inclusion in bf0a92ee77c54fad95d2c61c050df61c/f1 2023-02-09 16:55:18,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-02-09 16:55:18,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(777): Region bounds: first= last= 2023-02-09 16:55:18,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HRegion(2445): Flush status journal for bf0a92ee77c54fad95d2c61c050df61c: 2023-02-09 16:55:18,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230209/f1/152f5add23724cc1b427765c18431e61 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testGetAfterCompaction__f7lj2mjpc014aism46f978r2l5sk6392lvorf0q8pvfkjg6lamorqsatio84iihd/f1/152f5add23724cc1b427765c18431e61 2023-02-09 16:55:18,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testGetAfterCompaction__f7lj2mjpc014aism46f978r2l5sk6392lvorf0q8pvfkjg6lamorqsatio84iihd/f1/152f5add23724cc1b427765c18431e61 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/9cf3dd31f04d4abfb6da920fdbefae00_SeqId_12_ 2023-02-09 16:55:18,855 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(849): Loaded HFile hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testGetAfterCompaction__f7lj2mjpc014aism46f978r2l5sk6392lvorf0q8pvfkjg6lamorqsatio84iihd/f1/152f5add23724cc1b427765c18431e61 into bf0a92ee77c54fad95d2c61c050df61c/f1 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/9cf3dd31f04d4abfb6da920fdbefae00_SeqId_12_ - updating store file list. 2023-02-09 16:55:18,859 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(882): Loaded HFile hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/9cf3dd31f04d4abfb6da920fdbefae00_SeqId_12_ into bf0a92ee77c54fad95d2c61c050df61c/f1 2023-02-09 16:55:18,859 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(855): Successfully loaded hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testGetAfterCompaction__f7lj2mjpc014aism46f978r2l5sk6392lvorf0q8pvfkjg6lamorqsatio84iihd/f1/152f5add23724cc1b427765c18431e61 into bf0a92ee77c54fad95d2c61c050df61c/f1 (new location: hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/9cf3dd31f04d4abfb6da920fdbefae00_SeqId_12_) 2023-02-09 16:55:18,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testGetAfterCompaction__f7lj2mjpc014aism46f978r2l5sk6392lvorf0q8pvfkjg6lamorqsatio84iihd/f1/152f5add23724cc1b427765c18431e61 2023-02-09 16:55:18,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(1912): bf0a92ee77c54fad95d2c61c050df61c/f1 is initiating minor compaction 2023-02-09 16:55:18,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@532e6d3c; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 16:55:18,860 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of bf0a92ee77c54fad95d2c61c050df61c/f1 in testGetAfterCompaction,,1675961714207.bf0a92ee77c54fad95d2c61c050df61c. 2023-02-09 16:55:18,860 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/fc3331746d0140eabefb70e06f4a77cd, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/9cf3dd31f04d4abfb6da920fdbefae00_SeqId_12_] into tmpdir=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/.tmp, totalSize=10.0 K 2023-02-09 16:55:18,860 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting fc3331746d0140eabefb70e06f4a77cd, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-09 16:55:18,860 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting 9cf3dd31f04d4abfb6da920fdbefae00_SeqId_12_, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-09 16:55:18,862 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230209 table='testGetAfterCompaction' column='f1' 2023-02-09 16:55:18,864 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 16:55:18,865 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230209ac6eb1fa8e054889a95c98a09350e1ce to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230209ac6eb1fa8e054889a95c98a09350e1ce 2023-02-09 16:55:18,867 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230209f877818c064945638998a571c6fb27d3 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230209f877818c064945638998a571c6fb27d3 2023-02-09 16:55:18,867 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testGetAfterCompaction 2 expired mob files are deleted 2023-02-09 16:55:18,867 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230209' 2023-02-09 16:55:18,867 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230209 for table='testGetAfterCompaction' and column='f1' 2023-02-09 16:55:18,867 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testGetAfterCompaction' column='f1' 2023-02-09 16:55:18,867 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] mob.MobUtils(840): end MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 16:55:18,868 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=74, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-02-09 16:55:18,869 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] throttle.PressureAwareThroughputController(145): bf0a92ee77c54fad95d2c61c050df61c#f1#compaction#77 average throughput is 0.13 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 16:55:18,869 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=74, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE in 888 msec 2023-02-09 16:55:18,896 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/29ca96ffb556482db6d30bb134570ead; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675961717142; access_time=1675961716328; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 16:55:18,896 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/9cf3dd31f04d4abfb6da920fdbefae00_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675961718812; access_time=1675961718001; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-09 16:55:18,896 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/fc3331746d0140eabefb70e06f4a77cd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675961717969; access_time=1675961717156; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 16:55:18,899 DEBUG [Listener at localhost/41619] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-09 16:55:18,903 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56690, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-09 16:55:18,904 INFO [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=35511] regionserver.RSRpcServices(1662): Compacting testGetAfterCompaction,,1675961714207.bf0a92ee77c54fad95d2c61c050df61c. 2023-02-09 16:55:18,904 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=35511] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 2 compacting, 0 eligible, 16 blocking 2023-02-09 16:55:18,904 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=35511] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-02-09 16:55:18,904 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=35511] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-02-09 16:55:18,904 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=35511] regionserver.CompactSplit(415): Not compacting testGetAfterCompaction,,1675961714207.bf0a92ee77c54fad95d2c61c050df61c. because compaction request was cancelled 2023-02-09 16:55:18,956 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/29ca96ffb556482db6d30bb134570ead; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675961717142; access_time=1675961716328; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 16:55:18,956 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/9cf3dd31f04d4abfb6da920fdbefae00_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675961718812; access_time=1675961718001; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-09 16:55:18,956 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/fc3331746d0140eabefb70e06f4a77cd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675961717969; access_time=1675961717156; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 16:55:19,007 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/29ca96ffb556482db6d30bb134570ead; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675961717142; access_time=1675961716328; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 16:55:19,007 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/9cf3dd31f04d4abfb6da920fdbefae00_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675961718812; access_time=1675961718001; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-09 16:55:19,007 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/fc3331746d0140eabefb70e06f4a77cd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675961717969; access_time=1675961717156; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 16:55:19,058 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/29ca96ffb556482db6d30bb134570ead; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675961717142; access_time=1675961716328; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 16:55:19,058 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/9cf3dd31f04d4abfb6da920fdbefae00_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675961718812; access_time=1675961718001; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-09 16:55:19,058 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/fc3331746d0140eabefb70e06f4a77cd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675961717969; access_time=1675961717156; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 16:55:19,109 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/29ca96ffb556482db6d30bb134570ead; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675961717142; access_time=1675961716328; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 16:55:19,109 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/9cf3dd31f04d4abfb6da920fdbefae00_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675961718812; access_time=1675961718001; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-09 16:55:19,109 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/fc3331746d0140eabefb70e06f4a77cd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675961717969; access_time=1675961717156; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 16:55:19,160 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/29ca96ffb556482db6d30bb134570ead; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675961717142; access_time=1675961716328; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 16:55:19,160 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/9cf3dd31f04d4abfb6da920fdbefae00_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675961718812; access_time=1675961718001; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-09 16:55:19,160 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/fc3331746d0140eabefb70e06f4a77cd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675961717969; access_time=1675961717156; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 16:55:19,211 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/29ca96ffb556482db6d30bb134570ead; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675961717142; access_time=1675961716328; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 16:55:19,211 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/9cf3dd31f04d4abfb6da920fdbefae00_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675961718812; access_time=1675961718001; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-09 16:55:19,211 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/fc3331746d0140eabefb70e06f4a77cd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675961717969; access_time=1675961717156; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 16:55:19,262 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/29ca96ffb556482db6d30bb134570ead; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675961717142; access_time=1675961716328; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 16:55:19,262 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/9cf3dd31f04d4abfb6da920fdbefae00_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675961718812; access_time=1675961718001; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-09 16:55:19,262 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/fc3331746d0140eabefb70e06f4a77cd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675961717969; access_time=1675961717156; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 16:55:19,313 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/29ca96ffb556482db6d30bb134570ead; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675961717142; access_time=1675961716328; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 16:55:19,313 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/9cf3dd31f04d4abfb6da920fdbefae00_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675961718812; access_time=1675961718001; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-09 16:55:19,313 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/fc3331746d0140eabefb70e06f4a77cd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675961717969; access_time=1675961717156; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 16:55:19,364 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/29ca96ffb556482db6d30bb134570ead; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675961717142; access_time=1675961716328; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 16:55:19,364 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/9cf3dd31f04d4abfb6da920fdbefae00_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675961718812; access_time=1675961718001; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-09 16:55:19,364 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/fc3331746d0140eabefb70e06f4a77cd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675961717969; access_time=1675961717156; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 16:55:19,415 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/29ca96ffb556482db6d30bb134570ead; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675961717142; access_time=1675961716328; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 16:55:19,415 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/9cf3dd31f04d4abfb6da920fdbefae00_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675961718812; access_time=1675961718001; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-09 16:55:19,415 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/fc3331746d0140eabefb70e06f4a77cd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675961717969; access_time=1675961717156; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 16:55:19,465 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/29ca96ffb556482db6d30bb134570ead; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675961717142; access_time=1675961716328; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 16:55:19,465 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/9cf3dd31f04d4abfb6da920fdbefae00_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675961718812; access_time=1675961718001; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-09 16:55:19,466 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/fc3331746d0140eabefb70e06f4a77cd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675961717969; access_time=1675961717156; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 16:55:19,516 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/29ca96ffb556482db6d30bb134570ead; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675961717142; access_time=1675961716328; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 16:55:19,516 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/9cf3dd31f04d4abfb6da920fdbefae00_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675961718812; access_time=1675961718001; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-09 16:55:19,516 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/fc3331746d0140eabefb70e06f4a77cd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675961717969; access_time=1675961717156; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 16:55:19,567 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/29ca96ffb556482db6d30bb134570ead; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675961717142; access_time=1675961716328; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 16:55:19,567 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/9cf3dd31f04d4abfb6da920fdbefae00_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675961718812; access_time=1675961718001; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-09 16:55:19,567 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/fc3331746d0140eabefb70e06f4a77cd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675961717969; access_time=1675961717156; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 16:55:19,618 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/29ca96ffb556482db6d30bb134570ead; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675961717142; access_time=1675961716328; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 16:55:19,618 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/9cf3dd31f04d4abfb6da920fdbefae00_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675961718812; access_time=1675961718001; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-09 16:55:19,618 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/fc3331746d0140eabefb70e06f4a77cd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675961717969; access_time=1675961717156; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 16:55:19,669 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/29ca96ffb556482db6d30bb134570ead; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675961717142; access_time=1675961716328; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 16:55:19,669 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/9cf3dd31f04d4abfb6da920fdbefae00_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675961718812; access_time=1675961718001; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-09 16:55:19,669 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/fc3331746d0140eabefb70e06f4a77cd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675961717969; access_time=1675961717156; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 16:55:19,684 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/.tmp/f1/0578227361c14e6fa2faa80a6a97ca96 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/0578227361c14e6fa2faa80a6a97ca96 2023-02-09 16:55:19,688 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 2 file(s) in bf0a92ee77c54fad95d2c61c050df61c/f1 of bf0a92ee77c54fad95d2c61c050df61c into 0578227361c14e6fa2faa80a6a97ca96(size=5.1 K), total size for store is 10.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-09 16:55:19,688 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for bf0a92ee77c54fad95d2c61c050df61c: 2023-02-09 16:55:19,688 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testGetAfterCompaction,,1675961714207.bf0a92ee77c54fad95d2c61c050df61c., storeName=f1, fileCount=2, fileSize=10.0 K (4.9 K, 5.1 K), priority=2, time=1675961718860; duration=0sec 2023-02-09 16:55:19,688 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 16:55:19,719 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-02-09 16:55:19,719 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro Metrics about HBase RegionObservers 2023-02-09 16:55:19,719 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/0578227361c14e6fa2faa80a6a97ca96; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1675961719680; access_time=1675961718866; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 16:55:19,719 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/29ca96ffb556482db6d30bb134570ead; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675961717142; access_time=1675961716328; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 16:55:19,720 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/9cf3dd31f04d4abfb6da920fdbefae00_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675961718812; access_time=1675961718001; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-09 16:55:19,720 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/fc3331746d0140eabefb70e06f4a77cd; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675961717969; access_time=1675961717156; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 16:55:19,744 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/fc3331746d0140eabefb70e06f4a77cd, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/9cf3dd31f04d4abfb6da920fdbefae00_SeqId_12_] to archive 2023-02-09 16:55:19,745 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 16:55:19,747 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/fc3331746d0140eabefb70e06f4a77cd to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/fc3331746d0140eabefb70e06f4a77cd 2023-02-09 16:55:19,748 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/9cf3dd31f04d4abfb6da920fdbefae00_SeqId_12_ to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/9cf3dd31f04d4abfb6da920fdbefae00_SeqId_12_ 2023-02-09 16:55:19,770 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/0578227361c14e6fa2faa80a6a97ca96; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1675961719680; access_time=1675961718866; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 16:55:19,770 INFO [Listener at localhost/41619] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/29ca96ffb556482db6d30bb134570ead; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675961717142; access_time=1675961716328; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 16:55:19,887 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:19,887 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:19,888 INFO [Listener at localhost/41619] client.HBaseAdmin$15(890): Started disable of testGetAfterCompaction 2023-02-09 16:55:19,893 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testGetAfterCompaction 2023-02-09 16:55:19,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure2.ProcedureExecutor(1029): Stored pid=75, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testGetAfterCompaction 2023-02-09 16:55:19,902 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675961719902"}]},"ts":"1675961719902"} 2023-02-09 16:55:19,903 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:19,903 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:19,903 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLING in hbase:meta 2023-02-09 16:55:19,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-02-09 16:55:19,905 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testGetAfterCompaction to state=DISABLING 2023-02-09 16:55:19,907 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=bf0a92ee77c54fad95d2c61c050df61c, UNASSIGN}] 2023-02-09 16:55:19,908 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=bf0a92ee77c54fad95d2c61c050df61c, UNASSIGN 2023-02-09 16:55:19,908 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=bf0a92ee77c54fad95d2c61c050df61c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:19,909 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1675961714207.bf0a92ee77c54fad95d2c61c050df61c.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1675961719908"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675961719908"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675961719908"}]},"ts":"1675961719908"} 2023-02-09 16:55:19,910 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; CloseRegionProcedure bf0a92ee77c54fad95d2c61c050df61c, server=jenkins-hbase4.apache.org,35511,1675961620699}] 2023-02-09 16:55:20,004 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:20,004 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:20,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-02-09 16:55:20,061 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close bf0a92ee77c54fad95d2c61c050df61c 2023-02-09 16:55:20,062 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing bf0a92ee77c54fad95d2c61c050df61c, disabling compactions & flushes 2023-02-09 16:55:20,062 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testGetAfterCompaction,,1675961714207.bf0a92ee77c54fad95d2c61c050df61c. 2023-02-09 16:55:20,062 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testGetAfterCompaction,,1675961714207.bf0a92ee77c54fad95d2c61c050df61c. 2023-02-09 16:55:20,062 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testGetAfterCompaction,,1675961714207.bf0a92ee77c54fad95d2c61c050df61c. after waiting 0 ms 2023-02-09 16:55:20,062 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testGetAfterCompaction,,1675961714207.bf0a92ee77c54fad95d2c61c050df61c. 2023-02-09 16:55:20,066 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-02-09 16:55:20,066 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-02-09 16:55:20,067 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testGetAfterCompaction,,1675961714207.bf0a92ee77c54fad95d2c61c050df61c. 2023-02-09 16:55:20,067 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for bf0a92ee77c54fad95d2c61c050df61c: Waiting for close lock at 1675961720062Running coprocessor pre-close hooks at 1675961720062Disabling compacts and flushes for region at 1675961720062Disabling writes for close at 1675961720062Writing region close event to WAL at 1675961720062Running coprocessor post-close hooks at 1675961720066 (+4 ms)Closed at 1675961720067 (+1 ms) 2023-02-09 16:55:20,068 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed bf0a92ee77c54fad95d2c61c050df61c 2023-02-09 16:55:20,069 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=bf0a92ee77c54fad95d2c61c050df61c, regionState=CLOSED 2023-02-09 16:55:20,069 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1675961714207.bf0a92ee77c54fad95d2c61c050df61c.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1675961720069"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675961720069"}]},"ts":"1675961720069"} 2023-02-09 16:55:20,071 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-02-09 16:55:20,071 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; CloseRegionProcedure bf0a92ee77c54fad95d2c61c050df61c, server=jenkins-hbase4.apache.org,35511,1675961620699 in 160 msec 2023-02-09 16:55:20,072 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=75 2023-02-09 16:55:20,072 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=75, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=bf0a92ee77c54fad95d2c61c050df61c, UNASSIGN in 164 msec 2023-02-09 16:55:20,073 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675961720073"}]},"ts":"1675961720073"} 2023-02-09 16:55:20,074 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLED in hbase:meta 2023-02-09 16:55:20,079 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testGetAfterCompaction to state=DISABLED 2023-02-09 16:55:20,080 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=75, state=SUCCESS; DisableTableProcedure table=testGetAfterCompaction in 184 msec 2023-02-09 16:55:20,205 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:20,205 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:20,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-02-09 16:55:20,206 INFO [Listener at localhost/41619] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testGetAfterCompaction, procId: 75 completed 2023-02-09 16:55:20,206 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:20,207 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:20,210 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testGetAfterCompaction 2023-02-09 16:55:20,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testGetAfterCompaction 2023-02-09 16:55:20,217 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-02-09 16:55:20,218 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=78, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-02-09 16:55:20,219 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:20,219 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:20,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=78 2023-02-09 16:55:20,222 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c 2023-02-09 16:55:20,224 DEBUG [HFileArchiver-12] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1, FileablePath, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/recovered.edits] 2023-02-09 16:55:20,228 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/0578227361c14e6fa2faa80a6a97ca96 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/0578227361c14e6fa2faa80a6a97ca96 2023-02-09 16:55:20,230 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/29ca96ffb556482db6d30bb134570ead to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/f1/29ca96ffb556482db6d30bb134570ead 2023-02-09 16:55:20,233 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/recovered.edits/15.seqid to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c/recovered.edits/15.seqid 2023-02-09 16:55:20,233 DEBUG [HFileArchiver-12] backup.HFileArchiver(596): Deleted hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/default/testGetAfterCompaction/bf0a92ee77c54fad95d2c61c050df61c 2023-02-09 16:55:20,233 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-02-09 16:55:20,234 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-02-09 16:55:20,234 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1] 2023-02-09 16:55:20,237 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230209f75104ea6f6b4378b4ef42eec5edb80d to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230209f75104ea6f6b4378b4ef42eec5edb80d 2023-02-09 16:55:20,238 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-02-09 16:55:20,240 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=78, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-02-09 16:55:20,261 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testGetAfterCompaction from hbase:meta 2023-02-09 16:55:20,263 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testGetAfterCompaction' descriptor. 2023-02-09 16:55:20,264 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=78, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-02-09 16:55:20,264 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testGetAfterCompaction' from region states. 2023-02-09 16:55:20,264 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction,,1675961714207.bf0a92ee77c54fad95d2c61c050df61c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675961720264"}]},"ts":"9223372036854775807"} 2023-02-09 16:55:20,266 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-09 16:55:20,266 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => bf0a92ee77c54fad95d2c61c050df61c, NAME => 'testGetAfterCompaction,,1675961714207.bf0a92ee77c54fad95d2c61c050df61c.', STARTKEY => '', ENDKEY => ''}] 2023-02-09 16:55:20,266 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testGetAfterCompaction' as deleted. 2023-02-09 16:55:20,266 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1675961720266"}]},"ts":"9223372036854775807"} 2023-02-09 16:55:20,267 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testGetAfterCompaction state from META 2023-02-09 16:55:20,269 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=78, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-02-09 16:55:20,270 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; DeleteTableProcedure table=testGetAfterCompaction in 58 msec 2023-02-09 16:55:20,320 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:20,320 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:20,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=78 2023-02-09 16:55:20,321 INFO [Listener at localhost/41619] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testGetAfterCompaction, procId: 78 completed 2023-02-09 16:55:20,334 INFO [Listener at localhost/41619] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=244 (was 242) - Thread LEAK? -, OpenFileDescriptor=613 (was 618), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=125 (was 136), ProcessCount=168 (was 168), AvailableMemoryMB=3025 (was 3029) 2023-02-09 16:55:20,344 INFO [Listener at localhost/41619] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=244, OpenFileDescriptor=613, MaxFileDescriptor=60000, SystemLoadAverage=125, ProcessCount=168, AvailableMemoryMB=3024 2023-02-09 16:55:20,345 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:20,345 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:20,347 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-02-09 16:55:20,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testCompactionWithHFileLink 2023-02-09 16:55:20,349 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 16:55:20,349 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testCompactionWithHFileLink" procId is: 79 2023-02-09 16:55:20,349 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:20,350 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 16:55:20,350 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:20,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-09 16:55:20,352 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a 2023-02-09 16:55:20,352 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183 2023-02-09 16:55:20,352 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554 2023-02-09 16:55:20,352 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a empty. 2023-02-09 16:55:20,352 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554 empty. 2023-02-09 16:55:20,352 DEBUG [HFileArchiver-14] backup.HFileArchiver(153): Directory hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183 empty. 2023-02-09 16:55:20,353 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a 2023-02-09 16:55:20,353 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554 2023-02-09 16:55:20,353 DEBUG [HFileArchiver-14] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183 2023-02-09 16:55:20,353 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testCompactionWithHFileLink regions 2023-02-09 16:55:20,450 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:20,451 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:20,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-09 16:55:20,652 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:20,652 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:20,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-09 16:55:20,761 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-02-09 16:55:20,762 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(7671): creating {ENCODED => 8f50653056db0fc97159c3a723710554, NAME => 'testCompactionWithHFileLink,2,1675961720347.8f50653056db0fc97159c3a723710554.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp 2023-02-09 16:55:20,762 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(7671): creating {ENCODED => 964f5813343e8a443a0a9846e8b60a1a, NAME => 'testCompactionWithHFileLink,,1675961720347.964f5813343e8a443a0a9846e8b60a1a.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp 2023-02-09 16:55:20,762 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(7671): creating {ENCODED => ff109ff5b69a09236d8e26cac06ad183, NAME => 'testCompactionWithHFileLink,1,1675961720347.ff109ff5b69a09236d8e26cac06ad183.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp 2023-02-09 16:55:20,953 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:20,953 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:20,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-09 16:55:21,169 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,2,1675961720347.8f50653056db0fc97159c3a723710554.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 16:55:21,169 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,1,1675961720347.ff109ff5b69a09236d8e26cac06ad183.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 16:55:21,169 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,,1675961720347.964f5813343e8a443a0a9846e8b60a1a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 16:55:21,169 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1603): Closing ff109ff5b69a09236d8e26cac06ad183, disabling compactions & flushes 2023-02-09 16:55:21,169 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1603): Closing 964f5813343e8a443a0a9846e8b60a1a, disabling compactions & flushes 2023-02-09 16:55:21,169 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,1,1675961720347.ff109ff5b69a09236d8e26cac06ad183. 2023-02-09 16:55:21,169 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1675961720347.ff109ff5b69a09236d8e26cac06ad183. 2023-02-09 16:55:21,169 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,,1675961720347.964f5813343e8a443a0a9846e8b60a1a. 2023-02-09 16:55:21,169 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,1,1675961720347.ff109ff5b69a09236d8e26cac06ad183. after waiting 0 ms 2023-02-09 16:55:21,169 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,1,1675961720347.ff109ff5b69a09236d8e26cac06ad183. 2023-02-09 16:55:21,169 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1603): Closing 8f50653056db0fc97159c3a723710554, disabling compactions & flushes 2023-02-09 16:55:21,169 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,1,1675961720347.ff109ff5b69a09236d8e26cac06ad183. 2023-02-09 16:55:21,169 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,,1675961720347.964f5813343e8a443a0a9846e8b60a1a. 2023-02-09 16:55:21,169 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1557): Region close journal for ff109ff5b69a09236d8e26cac06ad183: Waiting for close lock at 1675961721169Disabling compacts and flushes for region at 1675961721169Disabling writes for close at 1675961721169Writing region close event to WAL at 1675961721169Closed at 1675961721169 2023-02-09 16:55:21,169 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,2,1675961720347.8f50653056db0fc97159c3a723710554. 2023-02-09 16:55:21,169 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1675961720347.8f50653056db0fc97159c3a723710554. 2023-02-09 16:55:21,169 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,2,1675961720347.8f50653056db0fc97159c3a723710554. after waiting 0 ms 2023-02-09 16:55:21,169 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,2,1675961720347.8f50653056db0fc97159c3a723710554. 2023-02-09 16:55:21,169 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,,1675961720347.964f5813343e8a443a0a9846e8b60a1a. after waiting 0 ms 2023-02-09 16:55:21,169 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,2,1675961720347.8f50653056db0fc97159c3a723710554. 2023-02-09 16:55:21,169 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,,1675961720347.964f5813343e8a443a0a9846e8b60a1a. 2023-02-09 16:55:21,170 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1557): Region close journal for 8f50653056db0fc97159c3a723710554: Waiting for close lock at 1675961721169Disabling compacts and flushes for region at 1675961721169Disabling writes for close at 1675961721169Writing region close event to WAL at 1675961721169Closed at 1675961721169 2023-02-09 16:55:21,170 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,,1675961720347.964f5813343e8a443a0a9846e8b60a1a. 2023-02-09 16:55:21,170 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1557): Region close journal for 964f5813343e8a443a0a9846e8b60a1a: Waiting for close lock at 1675961721169Disabling compacts and flushes for region at 1675961721169Disabling writes for close at 1675961721169Writing region close event to WAL at 1675961721170 (+1 ms)Closed at 1675961721170 2023-02-09 16:55:21,172 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 16:55:21,172 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1675961720347.ff109ff5b69a09236d8e26cac06ad183.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675961721172"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675961721172"}]},"ts":"1675961721172"} 2023-02-09 16:55:21,173 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1675961720347.8f50653056db0fc97159c3a723710554.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675961721172"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675961721172"}]},"ts":"1675961721172"} 2023-02-09 16:55:21,173 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1675961720347.964f5813343e8a443a0a9846e8b60a1a.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675961721172"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675961721172"}]},"ts":"1675961721172"} 2023-02-09 16:55:21,174 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-02-09 16:55:21,175 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 16:55:21,175 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675961721175"}]},"ts":"1675961721175"} 2023-02-09 16:55:21,176 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-02-09 16:55:21,180 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=964f5813343e8a443a0a9846e8b60a1a, ASSIGN}, {pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=ff109ff5b69a09236d8e26cac06ad183, ASSIGN}, {pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=8f50653056db0fc97159c3a723710554, ASSIGN}] 2023-02-09 16:55:21,182 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=ff109ff5b69a09236d8e26cac06ad183, ASSIGN 2023-02-09 16:55:21,182 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=964f5813343e8a443a0a9846e8b60a1a, ASSIGN 2023-02-09 16:55:21,182 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=8f50653056db0fc97159c3a723710554, ASSIGN 2023-02-09 16:55:21,182 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=ff109ff5b69a09236d8e26cac06ad183, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35511,1675961620699; forceNewPlan=false, retain=false 2023-02-09 16:55:21,182 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=8f50653056db0fc97159c3a723710554, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35511,1675961620699; forceNewPlan=false, retain=false 2023-02-09 16:55:21,182 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=964f5813343e8a443a0a9846e8b60a1a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35511,1675961620699; forceNewPlan=false, retain=false 2023-02-09 16:55:21,334 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=964f5813343e8a443a0a9846e8b60a1a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:21,334 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=8f50653056db0fc97159c3a723710554, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:21,334 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=ff109ff5b69a09236d8e26cac06ad183, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:21,334 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1675961720347.964f5813343e8a443a0a9846e8b60a1a.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675961721334"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675961721334"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675961721334"}]},"ts":"1675961721334"} 2023-02-09 16:55:21,334 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1675961720347.ff109ff5b69a09236d8e26cac06ad183.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675961721334"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675961721334"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675961721334"}]},"ts":"1675961721334"} 2023-02-09 16:55:21,334 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1675961720347.8f50653056db0fc97159c3a723710554.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675961721334"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675961721334"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675961721334"}]},"ts":"1675961721334"} 2023-02-09 16:55:21,336 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=83, ppid=80, state=RUNNABLE; OpenRegionProcedure 964f5813343e8a443a0a9846e8b60a1a, server=jenkins-hbase4.apache.org,35511,1675961620699}] 2023-02-09 16:55:21,336 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=84, ppid=81, state=RUNNABLE; OpenRegionProcedure ff109ff5b69a09236d8e26cac06ad183, server=jenkins-hbase4.apache.org,35511,1675961620699}] 2023-02-09 16:55:21,338 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=82, state=RUNNABLE; OpenRegionProcedure 8f50653056db0fc97159c3a723710554, server=jenkins-hbase4.apache.org,35511,1675961620699}] 2023-02-09 16:55:21,454 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:21,454 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:21,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-09 16:55:21,491 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,1,1675961720347.ff109ff5b69a09236d8e26cac06ad183. 2023-02-09 16:55:21,491 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ff109ff5b69a09236d8e26cac06ad183, NAME => 'testCompactionWithHFileLink,1,1675961720347.ff109ff5b69a09236d8e26cac06ad183.', STARTKEY => '1', ENDKEY => '2'} 2023-02-09 16:55:21,491 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink ff109ff5b69a09236d8e26cac06ad183 2023-02-09 16:55:21,491 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,1,1675961720347.ff109ff5b69a09236d8e26cac06ad183.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 16:55:21,491 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for ff109ff5b69a09236d8e26cac06ad183 2023-02-09 16:55:21,491 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for ff109ff5b69a09236d8e26cac06ad183 2023-02-09 16:55:21,492 INFO [StoreOpener-ff109ff5b69a09236d8e26cac06ad183-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region ff109ff5b69a09236d8e26cac06ad183 2023-02-09 16:55:21,494 DEBUG [StoreOpener-ff109ff5b69a09236d8e26cac06ad183-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family1 2023-02-09 16:55:21,494 DEBUG [StoreOpener-ff109ff5b69a09236d8e26cac06ad183-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family1 2023-02-09 16:55:21,494 INFO [StoreOpener-ff109ff5b69a09236d8e26cac06ad183-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ff109ff5b69a09236d8e26cac06ad183 columnFamilyName family1 2023-02-09 16:55:21,495 INFO [StoreOpener-ff109ff5b69a09236d8e26cac06ad183-1] regionserver.HStore(310): Store=ff109ff5b69a09236d8e26cac06ad183/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 16:55:21,495 INFO [StoreOpener-ff109ff5b69a09236d8e26cac06ad183-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region ff109ff5b69a09236d8e26cac06ad183 2023-02-09 16:55:21,496 DEBUG [StoreOpener-ff109ff5b69a09236d8e26cac06ad183-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family2 2023-02-09 16:55:21,496 DEBUG [StoreOpener-ff109ff5b69a09236d8e26cac06ad183-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family2 2023-02-09 16:55:21,497 INFO [StoreOpener-ff109ff5b69a09236d8e26cac06ad183-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ff109ff5b69a09236d8e26cac06ad183 columnFamilyName family2 2023-02-09 16:55:21,498 INFO [StoreOpener-ff109ff5b69a09236d8e26cac06ad183-1] regionserver.HStore(310): Store=ff109ff5b69a09236d8e26cac06ad183/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 16:55:21,499 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183 2023-02-09 16:55:21,499 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183 2023-02-09 16:55:21,500 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 16:55:21,501 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for ff109ff5b69a09236d8e26cac06ad183 2023-02-09 16:55:21,503 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 16:55:21,503 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened ff109ff5b69a09236d8e26cac06ad183; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66262088, jitterRate=-0.012617945671081543}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 16:55:21,503 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for ff109ff5b69a09236d8e26cac06ad183: Running coprocessor pre-open hook at 1675961721491Writing region info on filesystem at 1675961721491Initializing all the Stores at 1675961721492 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675961721492Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675961721492Cleaning up temporary data from old regions at 1675961721499 (+7 ms)Cleaning up detritus from prior splits at 1675961721500 (+1 ms)Running coprocessor post-open hooks at 1675961721503 (+3 ms)Region opened successfully at 1675961721503 2023-02-09 16:55:21,504 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,1,1675961720347.ff109ff5b69a09236d8e26cac06ad183., pid=84, masterSystemTime=1675961721488 2023-02-09 16:55:21,505 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,1,1675961720347.ff109ff5b69a09236d8e26cac06ad183. 2023-02-09 16:55:21,505 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,1,1675961720347.ff109ff5b69a09236d8e26cac06ad183. 2023-02-09 16:55:21,505 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,,1675961720347.964f5813343e8a443a0a9846e8b60a1a. 2023-02-09 16:55:21,505 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 964f5813343e8a443a0a9846e8b60a1a, NAME => 'testCompactionWithHFileLink,,1675961720347.964f5813343e8a443a0a9846e8b60a1a.', STARTKEY => '', ENDKEY => '1'} 2023-02-09 16:55:21,506 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 964f5813343e8a443a0a9846e8b60a1a 2023-02-09 16:55:21,506 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=ff109ff5b69a09236d8e26cac06ad183, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:21,506 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,,1675961720347.964f5813343e8a443a0a9846e8b60a1a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 16:55:21,506 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 964f5813343e8a443a0a9846e8b60a1a 2023-02-09 16:55:21,506 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 964f5813343e8a443a0a9846e8b60a1a 2023-02-09 16:55:21,506 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1675961720347.ff109ff5b69a09236d8e26cac06ad183.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675961721506"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675961721506"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675961721506"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675961721506"}]},"ts":"1675961721506"} 2023-02-09 16:55:21,507 INFO [StoreOpener-964f5813343e8a443a0a9846e8b60a1a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 964f5813343e8a443a0a9846e8b60a1a 2023-02-09 16:55:21,508 DEBUG [StoreOpener-964f5813343e8a443a0a9846e8b60a1a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family1 2023-02-09 16:55:21,508 DEBUG [StoreOpener-964f5813343e8a443a0a9846e8b60a1a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family1 2023-02-09 16:55:21,508 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=84, resume processing ppid=81 2023-02-09 16:55:21,508 INFO [StoreOpener-964f5813343e8a443a0a9846e8b60a1a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 964f5813343e8a443a0a9846e8b60a1a columnFamilyName family1 2023-02-09 16:55:21,508 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=84, ppid=81, state=SUCCESS; OpenRegionProcedure ff109ff5b69a09236d8e26cac06ad183, server=jenkins-hbase4.apache.org,35511,1675961620699 in 171 msec 2023-02-09 16:55:21,509 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=ff109ff5b69a09236d8e26cac06ad183, ASSIGN in 329 msec 2023-02-09 16:55:21,509 INFO [StoreOpener-964f5813343e8a443a0a9846e8b60a1a-1] regionserver.HStore(310): Store=964f5813343e8a443a0a9846e8b60a1a/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 16:55:21,510 INFO [StoreOpener-964f5813343e8a443a0a9846e8b60a1a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 964f5813343e8a443a0a9846e8b60a1a 2023-02-09 16:55:21,510 DEBUG [StoreOpener-964f5813343e8a443a0a9846e8b60a1a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family2 2023-02-09 16:55:21,510 DEBUG [StoreOpener-964f5813343e8a443a0a9846e8b60a1a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family2 2023-02-09 16:55:21,511 INFO [StoreOpener-964f5813343e8a443a0a9846e8b60a1a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 964f5813343e8a443a0a9846e8b60a1a columnFamilyName family2 2023-02-09 16:55:21,511 INFO [StoreOpener-964f5813343e8a443a0a9846e8b60a1a-1] regionserver.HStore(310): Store=964f5813343e8a443a0a9846e8b60a1a/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 16:55:21,512 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a 2023-02-09 16:55:21,512 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a 2023-02-09 16:55:21,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 16:55:21,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 964f5813343e8a443a0a9846e8b60a1a 2023-02-09 16:55:21,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 16:55:21,516 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 964f5813343e8a443a0a9846e8b60a1a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74934092, jitterRate=0.11660498380661011}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 16:55:21,517 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 964f5813343e8a443a0a9846e8b60a1a: Running coprocessor pre-open hook at 1675961721506Writing region info on filesystem at 1675961721506Initializing all the Stores at 1675961721507 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675961721507Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675961721507Cleaning up temporary data from old regions at 1675961721513 (+6 ms)Cleaning up detritus from prior splits at 1675961721513Running coprocessor post-open hooks at 1675961721517 (+4 ms)Region opened successfully at 1675961721517 2023-02-09 16:55:21,517 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,,1675961720347.964f5813343e8a443a0a9846e8b60a1a., pid=83, masterSystemTime=1675961721488 2023-02-09 16:55:21,518 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,,1675961720347.964f5813343e8a443a0a9846e8b60a1a. 2023-02-09 16:55:21,518 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,,1675961720347.964f5813343e8a443a0a9846e8b60a1a. 2023-02-09 16:55:21,518 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,2,1675961720347.8f50653056db0fc97159c3a723710554. 2023-02-09 16:55:21,518 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 8f50653056db0fc97159c3a723710554, NAME => 'testCompactionWithHFileLink,2,1675961720347.8f50653056db0fc97159c3a723710554.', STARTKEY => '2', ENDKEY => ''} 2023-02-09 16:55:21,518 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=964f5813343e8a443a0a9846e8b60a1a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:21,519 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 8f50653056db0fc97159c3a723710554 2023-02-09 16:55:21,519 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1675961720347.964f5813343e8a443a0a9846e8b60a1a.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675961721518"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675961721518"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675961721518"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675961721518"}]},"ts":"1675961721518"} 2023-02-09 16:55:21,519 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,2,1675961720347.8f50653056db0fc97159c3a723710554.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 16:55:21,519 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 8f50653056db0fc97159c3a723710554 2023-02-09 16:55:21,519 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 8f50653056db0fc97159c3a723710554 2023-02-09 16:55:21,520 INFO [StoreOpener-8f50653056db0fc97159c3a723710554-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 8f50653056db0fc97159c3a723710554 2023-02-09 16:55:21,521 DEBUG [StoreOpener-8f50653056db0fc97159c3a723710554-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1 2023-02-09 16:55:21,521 DEBUG [StoreOpener-8f50653056db0fc97159c3a723710554-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1 2023-02-09 16:55:21,521 INFO [StoreOpener-8f50653056db0fc97159c3a723710554-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8f50653056db0fc97159c3a723710554 columnFamilyName family1 2023-02-09 16:55:21,521 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=83, resume processing ppid=80 2023-02-09 16:55:21,521 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=83, ppid=80, state=SUCCESS; OpenRegionProcedure 964f5813343e8a443a0a9846e8b60a1a, server=jenkins-hbase4.apache.org,35511,1675961620699 in 184 msec 2023-02-09 16:55:21,522 INFO [StoreOpener-8f50653056db0fc97159c3a723710554-1] regionserver.HStore(310): Store=8f50653056db0fc97159c3a723710554/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 16:55:21,522 INFO [StoreOpener-8f50653056db0fc97159c3a723710554-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 8f50653056db0fc97159c3a723710554 2023-02-09 16:55:21,522 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=80, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=964f5813343e8a443a0a9846e8b60a1a, ASSIGN in 342 msec 2023-02-09 16:55:21,523 DEBUG [StoreOpener-8f50653056db0fc97159c3a723710554-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family2 2023-02-09 16:55:21,523 DEBUG [StoreOpener-8f50653056db0fc97159c3a723710554-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family2 2023-02-09 16:55:21,524 INFO [StoreOpener-8f50653056db0fc97159c3a723710554-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8f50653056db0fc97159c3a723710554 columnFamilyName family2 2023-02-09 16:55:21,524 INFO [StoreOpener-8f50653056db0fc97159c3a723710554-1] regionserver.HStore(310): Store=8f50653056db0fc97159c3a723710554/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 16:55:21,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554 2023-02-09 16:55:21,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554 2023-02-09 16:55:21,526 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 16:55:21,527 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 8f50653056db0fc97159c3a723710554 2023-02-09 16:55:21,528 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 16:55:21,529 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 8f50653056db0fc97159c3a723710554; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71040142, jitterRate=0.058580607175827026}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 16:55:21,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 8f50653056db0fc97159c3a723710554: Running coprocessor pre-open hook at 1675961721519Writing region info on filesystem at 1675961721519Initializing all the Stores at 1675961721520 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675961721520Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675961721520Cleaning up temporary data from old regions at 1675961721526 (+6 ms)Cleaning up detritus from prior splits at 1675961721526Running coprocessor post-open hooks at 1675961721529 (+3 ms)Region opened successfully at 1675961721529 2023-02-09 16:55:21,529 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,2,1675961720347.8f50653056db0fc97159c3a723710554., pid=85, masterSystemTime=1675961721488 2023-02-09 16:55:21,531 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,2,1675961720347.8f50653056db0fc97159c3a723710554. 2023-02-09 16:55:21,531 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,2,1675961720347.8f50653056db0fc97159c3a723710554. 2023-02-09 16:55:21,531 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=8f50653056db0fc97159c3a723710554, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:21,531 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1675961720347.8f50653056db0fc97159c3a723710554.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675961721531"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675961721531"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675961721531"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675961721531"}]},"ts":"1675961721531"} 2023-02-09 16:55:21,533 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=82 2023-02-09 16:55:21,533 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=82, state=SUCCESS; OpenRegionProcedure 8f50653056db0fc97159c3a723710554, server=jenkins-hbase4.apache.org,35511,1675961620699 in 195 msec 2023-02-09 16:55:21,534 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=79 2023-02-09 16:55:21,534 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=8f50653056db0fc97159c3a723710554, ASSIGN in 353 msec 2023-02-09 16:55:21,535 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 16:55:21,535 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675961721535"}]},"ts":"1675961721535"} 2023-02-09 16:55:21,536 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-02-09 16:55:21,538 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 16:55:21,539 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; CreateTableProcedure table=testCompactionWithHFileLink in 1.1910 sec 2023-02-09 16:55:22,455 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:22,456 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:22,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-09 16:55:22,457 INFO [Listener at localhost/41619] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testCompactionWithHFileLink, procId: 79 completed 2023-02-09 16:55:22,463 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,,1675961720347.964f5813343e8a443a0a9846e8b60a1a. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 16:55:22,464 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,1,1675961720347.ff109ff5b69a09236d8e26cac06ad183. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 16:55:22,465 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,2,1675961720347.8f50653056db0fc97159c3a723710554. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 16:55:22,468 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:22,468 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:22,468 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:55:22,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-02-09 16:55:22,470 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-02-09 16:55:22,470 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:55:22,470 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-02-09 16:55:22,470 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-02-09 16:55:22,470 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 16:55:22,470 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-09 16:55:22,472 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:22,472 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:55:22,472 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:55:22,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:55:22,472 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:22,472 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:55:22,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-09 16:55:22,472 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 16:55:22,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:55:22,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-09 16:55:22,473 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-02-09 16:55:22,473 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-02-09 16:55:22,473 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-02-09 16:55:22,473 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:55:22,473 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-02-09 16:55:22,473 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1675961720347.ff109ff5b69a09236d8e26cac06ad183. 2023-02-09 16:55:22,473 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1675961720347.ff109ff5b69a09236d8e26cac06ad183. started... 2023-02-09 16:55:22,476 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing ff109ff5b69a09236d8e26cac06ad183 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-09 16:55:22,476 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1675961720347.8f50653056db0fc97159c3a723710554. 2023-02-09 16:55:22,476 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1675961720347.964f5813343e8a443a0a9846e8b60a1a. 2023-02-09 16:55:22,476 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-09 16:55:22,476 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:55:22,476 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1675961720347.964f5813343e8a443a0a9846e8b60a1a. started... 2023-02-09 16:55:22,476 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1675961720347.8f50653056db0fc97159c3a723710554. started... 2023-02-09 16:55:22,477 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 964f5813343e8a443a0a9846e8b60a1a 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-09 16:55:22,477 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 8f50653056db0fc97159c3a723710554 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-09 16:55:22,494 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302096bcc7efd6cc84d2fbda5375b5938e8be to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302096bcc7efd6cc84d2fbda5375b5938e8be 2023-02-09 16:55:22,496 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230209c06eb6440a0b47869da46e27ce12e759 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230209c06eb6440a0b47869da46e27ce12e759 2023-02-09 16:55:22,500 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/.tmp/family1/cdc0da56512c47e9905d91d398ff9cee 2023-02-09 16:55:22,894 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023020929b05f21007847e19c056e5dd4865367 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023020929b05f21007847e19c056e5dd4865367 2023-02-09 16:55:22,899 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/.tmp/family1/9960ca25ee884e899d44d73e77321d91 2023-02-09 16:55:22,914 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230209346859ce7e9a45b1857ee7f3a1bcc69c to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230209346859ce7e9a45b1857ee7f3a1bcc69c 2023-02-09 16:55:23,299 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/.tmp/family1/23928677550e4b8d89458a32e18e9063 2023-02-09 16:55:23,310 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230209c3380e409fd7453687655309ff29c642 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230209c3380e409fd7453687655309ff29c642 2023-02-09 16:55:23,318 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/.tmp/family2/6a91dabe164b468b8eb198799372a729 2023-02-09 16:55:23,321 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/.tmp/family1/cdc0da56512c47e9905d91d398ff9cee as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family1/cdc0da56512c47e9905d91d398ff9cee 2023-02-09 16:55:23,325 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family1/cdc0da56512c47e9905d91d398ff9cee, entries=4, sequenceid=5, filesize=5.4 K 2023-02-09 16:55:23,325 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/.tmp/family2/6a91dabe164b468b8eb198799372a729 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family2/6a91dabe164b468b8eb198799372a729 2023-02-09 16:55:23,328 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family2/6a91dabe164b468b8eb198799372a729, entries=2, sequenceid=5, filesize=5.1 K 2023-02-09 16:55:23,329 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 964f5813343e8a443a0a9846e8b60a1a in 852ms, sequenceid=5, compaction requested=false 2023-02-09 16:55:23,329 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-02-09 16:55:23,329 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 964f5813343e8a443a0a9846e8b60a1a: 2023-02-09 16:55:23,330 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1675961720347.964f5813343e8a443a0a9846e8b60a1a. 2023-02-09 16:55:23,330 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-09 16:55:23,712 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230209fed187fa50e54366af3a1ed6b3afc793 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230209fed187fa50e54366af3a1ed6b3afc793 2023-02-09 16:55:23,715 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/.tmp/family2/83269f5b6253457b801063cde566d9a5 2023-02-09 16:55:23,717 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/.tmp/family2/e1834c7e198d4a5492a909f9090dba11 2023-02-09 16:55:23,719 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/.tmp/family1/9960ca25ee884e899d44d73e77321d91 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1/9960ca25ee884e899d44d73e77321d91 2023-02-09 16:55:23,721 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/.tmp/family1/23928677550e4b8d89458a32e18e9063 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family1/23928677550e4b8d89458a32e18e9063 2023-02-09 16:55:23,722 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1/9960ca25ee884e899d44d73e77321d91, entries=4, sequenceid=5, filesize=5.4 K 2023-02-09 16:55:23,723 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/.tmp/family2/83269f5b6253457b801063cde566d9a5 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family2/83269f5b6253457b801063cde566d9a5 2023-02-09 16:55:23,724 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family1/23928677550e4b8d89458a32e18e9063, entries=4, sequenceid=5, filesize=5.4 K 2023-02-09 16:55:23,725 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/.tmp/family2/e1834c7e198d4a5492a909f9090dba11 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family2/e1834c7e198d4a5492a909f9090dba11 2023-02-09 16:55:23,726 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family2/83269f5b6253457b801063cde566d9a5, entries=2, sequenceid=5, filesize=5.1 K 2023-02-09 16:55:23,727 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 8f50653056db0fc97159c3a723710554 in 1250ms, sequenceid=5, compaction requested=false 2023-02-09 16:55:23,728 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 8f50653056db0fc97159c3a723710554: 2023-02-09 16:55:23,728 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1675961720347.8f50653056db0fc97159c3a723710554. 2023-02-09 16:55:23,728 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-09 16:55:23,729 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family2/e1834c7e198d4a5492a909f9090dba11, entries=2, sequenceid=5, filesize=5.1 K 2023-02-09 16:55:23,730 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for ff109ff5b69a09236d8e26cac06ad183 in 1254ms, sequenceid=5, compaction requested=false 2023-02-09 16:55:23,730 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for ff109ff5b69a09236d8e26cac06ad183: 2023-02-09 16:55:23,730 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1675961720347.ff109ff5b69a09236d8e26cac06ad183. 2023-02-09 16:55:23,730 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-09 16:55:23,730 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-09 16:55:23,730 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:23,730 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-02-09 16:55:23,730 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-02-09 16:55:23,732 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:23,732 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 16:55:23,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:23,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:55:23,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:55:23,732 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 16:55:23,732 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:55:23,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:55:23,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:55:23,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 16:55:23,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:23,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:55:23,733 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-02-09 16:55:23,734 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@18031509[Count = 0] remaining members to acquire global barrier 2023-02-09 16:55:23,734 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-02-09 16:55:23,734 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 16:55:23,735 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 16:55:23,735 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 16:55:23,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 16:55:23,735 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-02-09 16:55:23,735 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-02-09 16:55:23,735 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:55:23,735 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:23,735 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:55:23,737 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-02-09 16:55:23,737 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:55:23,737 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:23,737 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-02-09 16:55:23,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:23,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:55:23,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:55:23,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:55:23,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:55:23,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 16:55:23,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:23,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:55:23,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 16:55:23,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:23,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:55:23,739 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-02-09 16:55:23,739 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-02-09 16:55:23,739 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:55:23,739 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:55:23,739 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-02-09 16:55:23,739 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:55:23,740 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 16:55:23,740 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 16:55:23,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 16:55:23,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:55:23,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:55:23,740 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 16:55:23,740 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:55:23,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 16:55:23,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:55:23,741 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:23,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:55:23,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:55:23,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 16:55:23,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 16:55:23,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:55:23,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 16:55:23,742 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:23,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:23,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:55:23,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 16:55:23,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:23,743 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:55:23,743 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:55:23,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:55:23,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:55:23,743 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:23,743 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-02-09 16:55:23,744 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:55:23,743 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:55:23,744 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:55:23,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:55:23,744 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-09 16:55:23,744 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-09 16:55:23,744 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-02-09 16:55:23,744 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:23,744 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:55:23,744 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 16:55:23,744 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 16:55:23,744 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 16:55:23,844 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:55:23,844 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:23,844 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:23,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:55:23,846 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,,1675961720347.964f5813343e8a443a0a9846e8b60a1a. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 16:55:23,846 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,1,1675961720347.ff109ff5b69a09236d8e26cac06ad183. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 16:55:23,846 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,2,1675961720347.8f50653056db0fc97159c3a723710554. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 16:55:23,848 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:23,848 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:23,849 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:55:23,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-02-09 16:55:23,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-02-09 16:55:23,850 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-02-09 16:55:23,850 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:55:23,850 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-02-09 16:55:23,850 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-02-09 16:55:23,851 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 16:55:23,851 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-09 16:55:23,852 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:55:23,852 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:23,852 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:55:23,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:55:23,852 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:23,852 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:55:23,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-09 16:55:23,853 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 16:55:23,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:55:23,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-09 16:55:23,853 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-02-09 16:55:23,853 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-02-09 16:55:23,853 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-02-09 16:55:23,853 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-02-09 16:55:23,853 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:55:23,853 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-02-09 16:55:23,854 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1675961720347.ff109ff5b69a09236d8e26cac06ad183. 2023-02-09 16:55:23,854 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-09 16:55:23,854 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:55:23,854 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1675961720347.964f5813343e8a443a0a9846e8b60a1a. 2023-02-09 16:55:23,854 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1675961720347.ff109ff5b69a09236d8e26cac06ad183. started... 2023-02-09 16:55:23,854 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1675961720347.8f50653056db0fc97159c3a723710554. 2023-02-09 16:55:23,854 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1675961720347.964f5813343e8a443a0a9846e8b60a1a. started... 2023-02-09 16:55:23,854 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1675961720347.8f50653056db0fc97159c3a723710554. started... 2023-02-09 16:55:23,854 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing ff109ff5b69a09236d8e26cac06ad183 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-09 16:55:23,854 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 964f5813343e8a443a0a9846e8b60a1a 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-09 16:55:23,854 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 8f50653056db0fc97159c3a723710554 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-09 16:55:23,873 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230209a1c3b9e7c7924e958bf64ca5d6182f60 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230209a1c3b9e7c7924e958bf64ca5d6182f60 2023-02-09 16:55:24,268 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302090b627555e2784172917cd94efc2d6532 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302090b627555e2784172917cd94efc2d6532 2023-02-09 16:55:24,269 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023020926654af107cf4162ad4745bfa2f1ca26 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023020926654af107cf4162ad4745bfa2f1ca26 2023-02-09 16:55:24,277 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/.tmp/family1/803335f8c9474fcf8a2ea08851a991db 2023-02-09 16:55:24,673 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/.tmp/family1/2040a0c0d6b74a2a84f36b91f50ba877 2023-02-09 16:55:24,674 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/.tmp/family1/bbd66b2a75854d769f68ec967526f8e4 2023-02-09 16:55:24,689 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230209bce6e987285a4c559249d798dce464ad to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230209bce6e987285a4c559249d798dce464ad 2023-02-09 16:55:25,088 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302094648339c3a1a4e5bb11592c5c9702e25 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302094648339c3a1a4e5bb11592c5c9702e25 2023-02-09 16:55:25,088 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230209904d495414744a3ebf16ef6e61e5424e to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230209904d495414744a3ebf16ef6e61e5424e 2023-02-09 16:55:25,094 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/.tmp/family2/cf952d5d378641a494409f4684fd499b 2023-02-09 16:55:25,097 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/.tmp/family1/803335f8c9474fcf8a2ea08851a991db as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family1/803335f8c9474fcf8a2ea08851a991db 2023-02-09 16:55:25,100 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family1/803335f8c9474fcf8a2ea08851a991db, entries=4, sequenceid=9, filesize=5.4 K 2023-02-09 16:55:25,101 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/.tmp/family2/cf952d5d378641a494409f4684fd499b as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family2/cf952d5d378641a494409f4684fd499b 2023-02-09 16:55:25,104 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family2/cf952d5d378641a494409f4684fd499b, entries=2, sequenceid=9, filesize=5.1 K 2023-02-09 16:55:25,105 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for ff109ff5b69a09236d8e26cac06ad183 in 1251ms, sequenceid=9, compaction requested=false 2023-02-09 16:55:25,105 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for ff109ff5b69a09236d8e26cac06ad183: 2023-02-09 16:55:25,105 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1675961720347.ff109ff5b69a09236d8e26cac06ad183. 2023-02-09 16:55:25,105 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-09 16:55:25,493 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/.tmp/family2/253a38900d1948339df6cb97b5c85255 2023-02-09 16:55:25,493 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/.tmp/family2/61d7c5d467734196aaf47bb8a75ee866 2023-02-09 16:55:25,497 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/.tmp/family1/bbd66b2a75854d769f68ec967526f8e4 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1/bbd66b2a75854d769f68ec967526f8e4 2023-02-09 16:55:25,497 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/.tmp/family1/2040a0c0d6b74a2a84f36b91f50ba877 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family1/2040a0c0d6b74a2a84f36b91f50ba877 2023-02-09 16:55:25,501 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1/bbd66b2a75854d769f68ec967526f8e4, entries=4, sequenceid=9, filesize=5.4 K 2023-02-09 16:55:25,501 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family1/2040a0c0d6b74a2a84f36b91f50ba877, entries=4, sequenceid=9, filesize=5.4 K 2023-02-09 16:55:25,501 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/.tmp/family2/253a38900d1948339df6cb97b5c85255 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family2/253a38900d1948339df6cb97b5c85255 2023-02-09 16:55:25,502 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/.tmp/family2/61d7c5d467734196aaf47bb8a75ee866 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family2/61d7c5d467734196aaf47bb8a75ee866 2023-02-09 16:55:25,505 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family2/253a38900d1948339df6cb97b5c85255, entries=2, sequenceid=9, filesize=5.1 K 2023-02-09 16:55:25,506 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family2/61d7c5d467734196aaf47bb8a75ee866, entries=2, sequenceid=9, filesize=5.1 K 2023-02-09 16:55:25,506 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 964f5813343e8a443a0a9846e8b60a1a in 1652ms, sequenceid=9, compaction requested=false 2023-02-09 16:55:25,506 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 8f50653056db0fc97159c3a723710554 in 1652ms, sequenceid=9, compaction requested=false 2023-02-09 16:55:25,506 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 964f5813343e8a443a0a9846e8b60a1a: 2023-02-09 16:55:25,506 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 8f50653056db0fc97159c3a723710554: 2023-02-09 16:55:25,506 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1675961720347.8f50653056db0fc97159c3a723710554. 2023-02-09 16:55:25,506 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1675961720347.964f5813343e8a443a0a9846e8b60a1a. 2023-02-09 16:55:25,506 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-09 16:55:25,506 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-09 16:55:25,506 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-09 16:55:25,506 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:25,507 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-02-09 16:55:25,507 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-02-09 16:55:25,509 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:25,509 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 16:55:25,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:25,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:55:25,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:55:25,509 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 16:55:25,509 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:55:25,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:55:25,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:55:25,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 16:55:25,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:25,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:55:25,510 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-02-09 16:55:25,510 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5b400d1d[Count = 0] remaining members to acquire global barrier 2023-02-09 16:55:25,510 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-02-09 16:55:25,510 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 16:55:25,511 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 16:55:25,511 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 16:55:25,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 16:55:25,511 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-02-09 16:55:25,511 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-02-09 16:55:25,512 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:55:25,512 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:25,512 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:55:25,513 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-02-09 16:55:25,513 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:55:25,513 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:25,513 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-02-09 16:55:25,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:25,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:55:25,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:55:25,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:55:25,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:55:25,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 16:55:25,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:25,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:55:25,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 16:55:25,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:25,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:55:25,515 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-02-09 16:55:25,515 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-02-09 16:55:25,515 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:55:25,515 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:55:25,515 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-02-09 16:55:25,515 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:55:25,516 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 16:55:25,516 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 16:55:25,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 16:55:25,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:55:25,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:55:25,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 16:55:25,516 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:55:25,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 16:55:25,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:55:25,517 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:25,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:55:25,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:55:25,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 16:55:25,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 16:55:25,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:55:25,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 16:55:25,518 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:25,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:25,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:55:25,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 16:55:25,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:25,520 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:25,520 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:55:25,521 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-09 16:55:25,521 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-02-09 16:55:25,521 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-02-09 16:55:25,521 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:55:25,521 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-09 16:55:25,521 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:55:25,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:55:25,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:55:25,521 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:55:25,521 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:25,521 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 16:55:25,521 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 16:55:25,521 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-02-09 16:55:25,521 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 16:55:25,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:55:25,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:55:25,521 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:55:25,568 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-09 16:55:25,621 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:55:25,622 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:25,622 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:25,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:55:25,623 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,,1675961720347.964f5813343e8a443a0a9846e8b60a1a. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 16:55:25,624 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,1,1675961720347.ff109ff5b69a09236d8e26cac06ad183. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 16:55:25,624 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,2,1675961720347.8f50653056db0fc97159c3a723710554. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 16:55:25,625 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:25,626 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:25,626 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:55:25,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-02-09 16:55:25,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-02-09 16:55:25,629 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-02-09 16:55:25,629 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:55:25,629 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-02-09 16:55:25,629 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-02-09 16:55:25,629 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 16:55:25,629 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-09 16:55:25,630 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:25,630 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:55:25,630 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:55:25,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:55:25,631 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:25,631 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:55:25,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-09 16:55:25,631 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 16:55:25,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:55:25,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-09 16:55:25,632 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-02-09 16:55:25,632 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-02-09 16:55:25,632 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-02-09 16:55:25,632 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-02-09 16:55:25,632 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:55:25,632 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-02-09 16:55:25,632 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1675961720347.ff109ff5b69a09236d8e26cac06ad183. 2023-02-09 16:55:25,632 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1675961720347.8f50653056db0fc97159c3a723710554. 2023-02-09 16:55:25,632 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1675961720347.964f5813343e8a443a0a9846e8b60a1a. 2023-02-09 16:55:25,632 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-09 16:55:25,632 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:55:25,632 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1675961720347.964f5813343e8a443a0a9846e8b60a1a. started... 2023-02-09 16:55:25,632 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1675961720347.8f50653056db0fc97159c3a723710554. started... 2023-02-09 16:55:25,632 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1675961720347.ff109ff5b69a09236d8e26cac06ad183. started... 2023-02-09 16:55:25,633 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 964f5813343e8a443a0a9846e8b60a1a 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-09 16:55:25,633 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing ff109ff5b69a09236d8e26cac06ad183 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-09 16:55:25,633 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 8f50653056db0fc97159c3a723710554 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-09 16:55:25,651 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230209ecf6c4e2f15a431dba58fdc14222af40 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230209ecf6c4e2f15a431dba58fdc14222af40 2023-02-09 16:55:26,051 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302095021cf77926d4cc381f0f752f0dacf42 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302095021cf77926d4cc381f0f752f0dacf42 2023-02-09 16:55:26,052 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230209cdaa8e47ff974e13abc12d6b32848b7f to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230209cdaa8e47ff974e13abc12d6b32848b7f 2023-02-09 16:55:26,058 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/.tmp/family1/95fe8fee4073477c8d575821319f6012 2023-02-09 16:55:26,459 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/.tmp/family1/4b47145a05c04482887ccb260167014f 2023-02-09 16:55:26,460 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/.tmp/family1/91b9b6b408b346eebf03b112c14765f1 2023-02-09 16:55:26,470 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230209cb92ed45f4cf400d97d85d402d1107e1 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230209cb92ed45f4cf400d97d85d402d1107e1 2023-02-09 16:55:26,478 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/.tmp/family2/2b4aaa427870487695f27db022840756 2023-02-09 16:55:26,481 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023020982231d331f9c40bf8405b7ee2dca67cc to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023020982231d331f9c40bf8405b7ee2dca67cc 2023-02-09 16:55:26,482 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/.tmp/family1/95fe8fee4073477c8d575821319f6012 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1/95fe8fee4073477c8d575821319f6012 2023-02-09 16:55:26,486 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1/95fe8fee4073477c8d575821319f6012, entries=4, sequenceid=13, filesize=5.4 K 2023-02-09 16:55:26,486 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/.tmp/family2/2b4aaa427870487695f27db022840756 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family2/2b4aaa427870487695f27db022840756 2023-02-09 16:55:26,490 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family2/2b4aaa427870487695f27db022840756, entries=2, sequenceid=13, filesize=5.1 K 2023-02-09 16:55:26,490 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 8f50653056db0fc97159c3a723710554 in 857ms, sequenceid=13, compaction requested=true 2023-02-09 16:55:26,491 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 8f50653056db0fc97159c3a723710554: 2023-02-09 16:55:26,491 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1675961720347.8f50653056db0fc97159c3a723710554. 2023-02-09 16:55:26,491 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-09 16:55:26,873 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230209112d4355b5014688bf9e143f89d91c07 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230209112d4355b5014688bf9e143f89d91c07 2023-02-09 16:55:26,885 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/.tmp/family2/1339a57e456946d083bc26ef990b55e2 2023-02-09 16:55:26,889 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/.tmp/family1/4b47145a05c04482887ccb260167014f as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family1/4b47145a05c04482887ccb260167014f 2023-02-09 16:55:26,892 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family1/4b47145a05c04482887ccb260167014f, entries=4, sequenceid=13, filesize=5.4 K 2023-02-09 16:55:26,893 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/.tmp/family2/1339a57e456946d083bc26ef990b55e2 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family2/1339a57e456946d083bc26ef990b55e2 2023-02-09 16:55:26,896 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family2/1339a57e456946d083bc26ef990b55e2, entries=2, sequenceid=13, filesize=5.1 K 2023-02-09 16:55:26,897 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for ff109ff5b69a09236d8e26cac06ad183 in 1264ms, sequenceid=13, compaction requested=true 2023-02-09 16:55:26,897 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for ff109ff5b69a09236d8e26cac06ad183: 2023-02-09 16:55:26,897 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1675961720347.ff109ff5b69a09236d8e26cac06ad183. 2023-02-09 16:55:26,897 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-09 16:55:27,278 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/.tmp/family2/41872818fa124596bdceeb9e4d43509d 2023-02-09 16:55:27,282 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/.tmp/family1/91b9b6b408b346eebf03b112c14765f1 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family1/91b9b6b408b346eebf03b112c14765f1 2023-02-09 16:55:27,286 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family1/91b9b6b408b346eebf03b112c14765f1, entries=4, sequenceid=13, filesize=5.4 K 2023-02-09 16:55:27,287 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/.tmp/family2/41872818fa124596bdceeb9e4d43509d as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family2/41872818fa124596bdceeb9e4d43509d 2023-02-09 16:55:27,292 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family2/41872818fa124596bdceeb9e4d43509d, entries=2, sequenceid=13, filesize=5.1 K 2023-02-09 16:55:27,293 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 964f5813343e8a443a0a9846e8b60a1a in 1659ms, sequenceid=13, compaction requested=true 2023-02-09 16:55:27,293 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 964f5813343e8a443a0a9846e8b60a1a: 2023-02-09 16:55:27,293 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1675961720347.964f5813343e8a443a0a9846e8b60a1a. 2023-02-09 16:55:27,293 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-09 16:55:27,293 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-09 16:55:27,293 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:27,293 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-02-09 16:55:27,293 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-02-09 16:55:27,294 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:27,294 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 16:55:27,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:27,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:55:27,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:55:27,295 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 16:55:27,295 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:55:27,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:55:27,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:55:27,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 16:55:27,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:27,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:55:27,296 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-02-09 16:55:27,296 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7bf14561[Count = 0] remaining members to acquire global barrier 2023-02-09 16:55:27,296 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-02-09 16:55:27,296 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 16:55:27,298 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 16:55:27,298 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 16:55:27,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 16:55:27,298 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-02-09 16:55:27,298 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-02-09 16:55:27,298 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:55:27,298 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:27,298 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:55:27,301 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-02-09 16:55:27,301 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:55:27,301 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:27,301 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-02-09 16:55:27,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:27,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:55:27,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:55:27,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:55:27,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:55:27,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 16:55:27,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:27,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:55:27,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 16:55:27,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:27,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:55:27,304 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-02-09 16:55:27,304 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-02-09 16:55:27,304 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:55:27,304 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:55:27,304 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-02-09 16:55:27,304 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:55:27,307 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 16:55:27,307 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 16:55:27,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 16:55:27,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 16:55:27,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:55:27,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 16:55:27,308 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:55:27,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:55:27,308 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:27,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:55:27,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:55:27,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:55:27,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 16:55:27,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 16:55:27,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:55:27,309 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:27,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 16:55:27,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:27,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:55:27,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 16:55:27,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:27,312 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:27,312 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:55:27,312 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-09 16:55:27,312 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:55:27,312 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-02-09 16:55:27,312 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:55:27,312 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-09 16:55:27,312 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:55:27,312 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:55:27,312 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:27,312 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-02-09 16:55:27,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:55:27,312 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 16:55:27,312 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-02-09 16:55:27,312 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:55:27,312 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 16:55:27,313 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:55:27,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:55:27,313 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 16:55:27,413 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:55:27,413 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:27,413 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:27,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:55:27,415 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,,1675961720347.964f5813343e8a443a0a9846e8b60a1a. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 16:55:27,415 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,1,1675961720347.ff109ff5b69a09236d8e26cac06ad183. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 16:55:27,415 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,2,1675961720347.8f50653056db0fc97159c3a723710554. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 16:55:27,417 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:27,417 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:27,417 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:55:27,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-02-09 16:55:27,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-02-09 16:55:27,419 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-02-09 16:55:27,420 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:55:27,420 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-02-09 16:55:27,420 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-02-09 16:55:27,420 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 16:55:27,420 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-09 16:55:27,421 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:55:27,421 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:27,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:55:27,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:55:27,422 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:27,422 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:55:27,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-09 16:55:27,422 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 16:55:27,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:55:27,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-09 16:55:27,422 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-02-09 16:55:27,422 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-02-09 16:55:27,423 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-02-09 16:55:27,423 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-02-09 16:55:27,423 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:55:27,423 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-02-09 16:55:27,423 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1675961720347.ff109ff5b69a09236d8e26cac06ad183. 2023-02-09 16:55:27,423 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1675961720347.ff109ff5b69a09236d8e26cac06ad183. started... 2023-02-09 16:55:27,423 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1675961720347.8f50653056db0fc97159c3a723710554. 2023-02-09 16:55:27,423 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1675961720347.8f50653056db0fc97159c3a723710554. started... 2023-02-09 16:55:27,423 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing ff109ff5b69a09236d8e26cac06ad183 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-09 16:55:27,423 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 8f50653056db0fc97159c3a723710554 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-09 16:55:27,423 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-09 16:55:27,423 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:55:27,424 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1675961720347.964f5813343e8a443a0a9846e8b60a1a. 2023-02-09 16:55:27,424 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1675961720347.964f5813343e8a443a0a9846e8b60a1a. started... 2023-02-09 16:55:27,424 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 964f5813343e8a443a0a9846e8b60a1a 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-09 16:55:27,442 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023020981776dbf549d496f905da8431c141ba1 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023020981776dbf549d496f905da8431c141ba1 2023-02-09 16:55:27,840 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302099bcabcbba46349fb98ce3d3b3b7fe317 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302099bcabcbba46349fb98ce3d3b3b7fe317 2023-02-09 16:55:27,843 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023020920cc890cd42446f29aa42a9853cbea21 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023020920cc890cd42446f29aa42a9853cbea21 2023-02-09 16:55:27,847 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/.tmp/family1/2f43f0ba911c4f1daa2bfa44de772d28 2023-02-09 16:55:28,248 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/.tmp/family1/b5696cb1277d4b3f9d2aaf063efb7dbd 2023-02-09 16:55:28,248 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/.tmp/family1/c9eca6421ae74a5d83702f06efa00d4f 2023-02-09 16:55:28,259 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023020979d05d633b5b49d5815baf8c663d8a01 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023020979d05d633b5b49d5815baf8c663d8a01 2023-02-09 16:55:28,661 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230209cc4b108d971e4a1aa5e627d23ee25a0e to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230209cc4b108d971e4a1aa5e627d23ee25a0e 2023-02-09 16:55:28,661 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302094930207ceb9141bfa31ba817e12f3a1c to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302094930207ceb9141bfa31ba817e12f3a1c 2023-02-09 16:55:28,663 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/.tmp/family2/6c223c6d2b8747279825b472ebbe3b88 2023-02-09 16:55:28,667 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/.tmp/family1/2f43f0ba911c4f1daa2bfa44de772d28 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family1/2f43f0ba911c4f1daa2bfa44de772d28 2023-02-09 16:55:28,671 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family1/2f43f0ba911c4f1daa2bfa44de772d28, entries=4, sequenceid=17, filesize=5.4 K 2023-02-09 16:55:28,671 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/.tmp/family2/6c223c6d2b8747279825b472ebbe3b88 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family2/6c223c6d2b8747279825b472ebbe3b88 2023-02-09 16:55:28,674 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family2/6c223c6d2b8747279825b472ebbe3b88, entries=2, sequenceid=17, filesize=5.1 K 2023-02-09 16:55:28,675 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 964f5813343e8a443a0a9846e8b60a1a in 1251ms, sequenceid=17, compaction requested=true 2023-02-09 16:55:28,675 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 964f5813343e8a443a0a9846e8b60a1a: 2023-02-09 16:55:28,675 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1675961720347.964f5813343e8a443a0a9846e8b60a1a. 2023-02-09 16:55:28,675 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-09 16:55:29,066 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/.tmp/family2/3a4e6fb98efd4681973e25dee0f08c97 2023-02-09 16:55:29,066 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/.tmp/family2/1c3a8a6e6ea44571b8fda362269e1731 2023-02-09 16:55:29,071 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/.tmp/family1/b5696cb1277d4b3f9d2aaf063efb7dbd as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1/b5696cb1277d4b3f9d2aaf063efb7dbd 2023-02-09 16:55:29,071 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/.tmp/family1/c9eca6421ae74a5d83702f06efa00d4f as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family1/c9eca6421ae74a5d83702f06efa00d4f 2023-02-09 16:55:29,075 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1/b5696cb1277d4b3f9d2aaf063efb7dbd, entries=4, sequenceid=17, filesize=5.4 K 2023-02-09 16:55:29,075 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family1/c9eca6421ae74a5d83702f06efa00d4f, entries=4, sequenceid=17, filesize=5.4 K 2023-02-09 16:55:29,076 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/.tmp/family2/1c3a8a6e6ea44571b8fda362269e1731 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family2/1c3a8a6e6ea44571b8fda362269e1731 2023-02-09 16:55:29,076 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/.tmp/family2/3a4e6fb98efd4681973e25dee0f08c97 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family2/3a4e6fb98efd4681973e25dee0f08c97 2023-02-09 16:55:29,080 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family2/1c3a8a6e6ea44571b8fda362269e1731, entries=2, sequenceid=17, filesize=5.1 K 2023-02-09 16:55:29,081 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 8f50653056db0fc97159c3a723710554 in 1658ms, sequenceid=17, compaction requested=true 2023-02-09 16:55:29,081 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 8f50653056db0fc97159c3a723710554: 2023-02-09 16:55:29,081 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1675961720347.8f50653056db0fc97159c3a723710554. 2023-02-09 16:55:29,081 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-09 16:55:29,084 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family2/3a4e6fb98efd4681973e25dee0f08c97, entries=2, sequenceid=17, filesize=5.1 K 2023-02-09 16:55:29,085 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for ff109ff5b69a09236d8e26cac06ad183 in 1662ms, sequenceid=17, compaction requested=true 2023-02-09 16:55:29,085 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for ff109ff5b69a09236d8e26cac06ad183: 2023-02-09 16:55:29,085 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1675961720347.ff109ff5b69a09236d8e26cac06ad183. 2023-02-09 16:55:29,085 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-09 16:55:29,085 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-09 16:55:29,085 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:29,085 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-02-09 16:55:29,085 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-02-09 16:55:29,086 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:29,086 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 16:55:29,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:29,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:55:29,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:55:29,087 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 16:55:29,087 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:55:29,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:55:29,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:55:29,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 16:55:29,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:29,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:55:29,088 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-02-09 16:55:29,088 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@47276a40[Count = 0] remaining members to acquire global barrier 2023-02-09 16:55:29,088 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-02-09 16:55:29,088 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 16:55:29,089 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 16:55:29,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 16:55:29,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 16:55:29,089 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-02-09 16:55:29,089 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-02-09 16:55:29,089 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:55:29,089 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:29,089 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:55:29,091 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-02-09 16:55:29,091 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:29,091 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:55:29,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:29,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:55:29,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:55:29,091 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-02-09 16:55:29,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:55:29,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:55:29,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 16:55:29,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:29,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:55:29,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 16:55:29,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:29,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:55:29,093 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-02-09 16:55:29,093 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:55:29,093 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:55:29,093 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-02-09 16:55:29,093 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-02-09 16:55:29,093 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:55:29,095 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 16:55:29,095 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 16:55:29,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 16:55:29,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:55:29,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:55:29,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 16:55:29,095 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:55:29,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 16:55:29,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:55:29,095 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:29,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:55:29,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:55:29,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 16:55:29,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 16:55:29,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:55:29,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 16:55:29,096 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:29,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:29,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:55:29,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 16:55:29,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:29,098 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:29,098 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:55:29,098 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:55:29,098 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:55:29,098 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-02-09 16:55:29,098 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:55:29,098 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-09 16:55:29,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:55:29,098 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-02-09 16:55:29,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:55:29,098 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-09 16:55:29,098 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:29,098 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-02-09 16:55:29,098 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 16:55:29,099 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:55:29,099 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 16:55:29,099 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 16:55:29,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:55:29,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:55:29,199 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:55:29,199 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:29,199 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:29,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:55:29,208 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:29,208 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:29,210 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb-1675961729200 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-09 16:55:29,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1675961729210 (current time:1675961729210). 2023-02-09 16:55:29,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-09 16:55:29,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] zookeeper.ReadOnlyZKClient(139): Connect 0x0bab3bca to 127.0.0.1:53887 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 16:55:29,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2558d1fe, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 16:55:29,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 16:55:29,223 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44464, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 16:55:29,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0bab3bca to 127.0.0.1:53887 2023-02-09 16:55:29,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 16:55:29,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-09 16:55:29,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb-1675961729200 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-09 16:55:29,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure2.ProcedureExecutor(1029): Stored pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-09 16:55:29,235 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-09 16:55:29,236 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=86, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1675962329236 2023-02-09 16:55:29,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb-1675961729200 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-09 16:55:29,236 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb-1675961729200 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-02-09 16:55:29,238 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=86, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-09 16:55:29,239 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-02-09 16:55:29,239 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=86, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 4 msec 2023-02-09 16:55:29,239 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-02-09 16:55:29,240 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=87, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED; timeout=600000, timestamp=1675962329240 2023-02-09 16:55:29,242 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb-1675961729200 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-02-09 16:55:29,242 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-09 16:55:29,246 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb-1675961729200 2023-02-09 16:55:29,247 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb-1675961729200' 2023-02-09 16:55:29,247 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 16:55:29,247 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb-1675961729200' starting 'acquire' 2023-02-09 16:55:29,247 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb-1675961729200', kicking off acquire phase on members. 2023-02-09 16:55:29,247 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1675961729200 2023-02-09 16:55:29,247 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb-1675961729200 2023-02-09 16:55:29,249 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 16:55:29,249 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb-1675961729200/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:29,249 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 16:55:29,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 16:55:29,249 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb-1675961729200/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:29,249 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:55:29,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb-1675961729200 2023-02-09 16:55:29,249 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1675961729200 2023-02-09 16:55:29,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-09 16:55:29,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb-1675961729200 2023-02-09 16:55:29,250 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb-1675961729200 from table testCompactionWithHFileLink type FLUSH 2023-02-09 16:55:29,252 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb-1675961729200 2023-02-09 16:55:29,252 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb-1675961729200' with timeout 300000ms 2023-02-09 16:55:29,252 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 16:55:29,252 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb-1675961729200' starting 'acquire' stage 2023-02-09 16:55:29,252 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb-1675961729200' locally acquired 2023-02-09 16:55:29,252 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (snaptb-1675961729200) in zk 2023-02-09 16:55:29,254 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb-1675961729200 2023-02-09 16:55:29,254 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1675961729200/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:29,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb-1675961729200/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:29,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:55:29,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 16:55:29,254 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1675961729200 2023-02-09 16:55:29,254 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb-1675961729200' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:55:29,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:55:29,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:55:29,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1675961729200 2023-02-09 16:55:29,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:29,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:55:29,255 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'snaptb-1675961729200' on coordinator 2023-02-09 16:55:29,255 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@470c94f0[Count = 0] remaining members to acquire global barrier 2023-02-09 16:55:29,255 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb-1675961729200' starting 'in-barrier' execution. 2023-02-09 16:55:29,255 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb-1675961729200 2023-02-09 16:55:29,256 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1675961729200 2023-02-09 16:55:29,256 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb-1675961729200 2023-02-09 16:55:29,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb-1675961729200 2023-02-09 16:55:29,256 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb-1675961729200' received 'reached' from coordinator. 2023-02-09 16:55:29,256 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1675961729200/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:29,256 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:55:29,257 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,1,1675961720347.ff109ff5b69a09236d8e26cac06ad183. 2023-02-09 16:55:29,257 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,2,1675961720347.8f50653056db0fc97159c3a723710554. 2023-02-09 16:55:29,257 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 3 regions 2023-02-09 16:55:29,257 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,,1675961720347.964f5813343e8a443a0a9846e8b60a1a. 2023-02-09 16:55:29,257 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-09 16:55:29,257 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,1,1675961720347.ff109ff5b69a09236d8e26cac06ad183. started... 2023-02-09 16:55:29,257 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,,1675961720347.964f5813343e8a443a0a9846e8b60a1a. started... 2023-02-09 16:55:29,257 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,2,1675961720347.8f50653056db0fc97159c3a723710554. started... 2023-02-09 16:55:29,258 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for ff109ff5b69a09236d8e26cac06ad183: 2023-02-09 16:55:29,258 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 964f5813343e8a443a0a9846e8b60a1a: 2023-02-09 16:55:29,258 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 8f50653056db0fc97159c3a723710554: 2023-02-09 16:55:29,258 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,,1675961720347.964f5813343e8a443a0a9846e8b60a1a.' region-info for snapshot=snaptb-1675961729200 2023-02-09 16:55:29,258 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,2,1675961720347.8f50653056db0fc97159c3a723710554.' region-info for snapshot=snaptb-1675961729200 2023-02-09 16:55:29,258 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,1,1675961720347.ff109ff5b69a09236d8e26cac06ad183.' region-info for snapshot=snaptb-1675961729200 2023-02-09 16:55:29,263 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 16:55:29,263 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 16:55:29,263 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 16:55:29,267 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family1/cdc0da56512c47e9905d91d398ff9cee, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family1/2040a0c0d6b74a2a84f36b91f50ba877, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family1/91b9b6b408b346eebf03b112c14765f1, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family1/2f43f0ba911c4f1daa2bfa44de772d28] hfiles 2023-02-09 16:55:29,267 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family1/23928677550e4b8d89458a32e18e9063, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family1/803335f8c9474fcf8a2ea08851a991db, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family1/4b47145a05c04482887ccb260167014f, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family1/c9eca6421ae74a5d83702f06efa00d4f] hfiles 2023-02-09 16:55:29,267 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1/9960ca25ee884e899d44d73e77321d91, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1/bbd66b2a75854d769f68ec967526f8e4, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1/95fe8fee4073477c8d575821319f6012, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1/b5696cb1277d4b3f9d2aaf063efb7dbd] hfiles 2023-02-09 16:55:29,267 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family1/23928677550e4b8d89458a32e18e9063 for snapshot=snaptb-1675961729200 2023-02-09 16:55:29,267 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family1/cdc0da56512c47e9905d91d398ff9cee for snapshot=snaptb-1675961729200 2023-02-09 16:55:29,267 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1/9960ca25ee884e899d44d73e77321d91 for snapshot=snaptb-1675961729200 2023-02-09 16:55:29,270 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1/bbd66b2a75854d769f68ec967526f8e4 for snapshot=snaptb-1675961729200 2023-02-09 16:55:29,270 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family1/803335f8c9474fcf8a2ea08851a991db for snapshot=snaptb-1675961729200 2023-02-09 16:55:29,270 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family1/2040a0c0d6b74a2a84f36b91f50ba877 for snapshot=snaptb-1675961729200 2023-02-09 16:55:29,270 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family1/4b47145a05c04482887ccb260167014f for snapshot=snaptb-1675961729200 2023-02-09 16:55:29,270 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1/95fe8fee4073477c8d575821319f6012 for snapshot=snaptb-1675961729200 2023-02-09 16:55:29,270 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family1/c9eca6421ae74a5d83702f06efa00d4f for snapshot=snaptb-1675961729200 2023-02-09 16:55:29,270 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family1/91b9b6b408b346eebf03b112c14765f1 for snapshot=snaptb-1675961729200 2023-02-09 16:55:29,270 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1/b5696cb1277d4b3f9d2aaf063efb7dbd for snapshot=snaptb-1675961729200 2023-02-09 16:55:29,270 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family2/e1834c7e198d4a5492a909f9090dba11, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family2/cf952d5d378641a494409f4684fd499b, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family2/1339a57e456946d083bc26ef990b55e2, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family2/3a4e6fb98efd4681973e25dee0f08c97] hfiles 2023-02-09 16:55:29,270 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family2/83269f5b6253457b801063cde566d9a5, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family2/253a38900d1948339df6cb97b5c85255, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family2/2b4aaa427870487695f27db022840756, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family2/1c3a8a6e6ea44571b8fda362269e1731] hfiles 2023-02-09 16:55:29,270 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family2/e1834c7e198d4a5492a909f9090dba11 for snapshot=snaptb-1675961729200 2023-02-09 16:55:29,270 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family1/2f43f0ba911c4f1daa2bfa44de772d28 for snapshot=snaptb-1675961729200 2023-02-09 16:55:29,270 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family2/cf952d5d378641a494409f4684fd499b for snapshot=snaptb-1675961729200 2023-02-09 16:55:29,270 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family2/6a91dabe164b468b8eb198799372a729, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family2/61d7c5d467734196aaf47bb8a75ee866, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family2/41872818fa124596bdceeb9e4d43509d, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family2/6c223c6d2b8747279825b472ebbe3b88] hfiles 2023-02-09 16:55:29,271 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family2/1339a57e456946d083bc26ef990b55e2 for snapshot=snaptb-1675961729200 2023-02-09 16:55:29,270 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family2/83269f5b6253457b801063cde566d9a5 for snapshot=snaptb-1675961729200 2023-02-09 16:55:29,271 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family2/3a4e6fb98efd4681973e25dee0f08c97 for snapshot=snaptb-1675961729200 2023-02-09 16:55:29,271 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family2/6a91dabe164b468b8eb198799372a729 for snapshot=snaptb-1675961729200 2023-02-09 16:55:29,271 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family2/253a38900d1948339df6cb97b5c85255 for snapshot=snaptb-1675961729200 2023-02-09 16:55:29,271 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family2/61d7c5d467734196aaf47bb8a75ee866 for snapshot=snaptb-1675961729200 2023-02-09 16:55:29,271 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family2/2b4aaa427870487695f27db022840756 for snapshot=snaptb-1675961729200 2023-02-09 16:55:29,271 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family2/41872818fa124596bdceeb9e4d43509d for snapshot=snaptb-1675961729200 2023-02-09 16:55:29,271 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family2/1c3a8a6e6ea44571b8fda362269e1731 for snapshot=snaptb-1675961729200 2023-02-09 16:55:29,271 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family2/6c223c6d2b8747279825b472ebbe3b88 for snapshot=snaptb-1675961729200 2023-02-09 16:55:29,342 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 16:55:29,342 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:29,343 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:29,485 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(142): Chore: CompactedHFilesCleaner missed its start time 2023-02-09 16:55:29,485 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-09 16:55:29,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1675961729200 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-09 16:55:29,485 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2652822b to 127.0.0.1:53887 2023-02-09 16:55:29,485 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 16:55:29,485 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-09 16:55:29,485 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x23cc18a3 to 127.0.0.1:53887 2023-02-09 16:55:29,485 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 16:55:29,485 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x522aa079 to 127.0.0.1:53887 2023-02-09 16:55:29,485 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 16:55:29,486 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-09 16:55:29,486 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x77fce872 to 127.0.0.1:53887 2023-02-09 16:55:29,486 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 16:55:29,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1675961729200 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-09 16:55:29,487 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-09 16:55:29,683 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,2,1675961720347.8f50653056db0fc97159c3a723710554. completed. 2023-02-09 16:55:29,683 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,1,1675961720347.ff109ff5b69a09236d8e26cac06ad183. completed. 2023-02-09 16:55:29,683 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,1,1675961720347.ff109ff5b69a09236d8e26cac06ad183. 2023-02-09 16:55:29,683 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,2,1675961720347.8f50653056db0fc97159c3a723710554. 2023-02-09 16:55:29,684 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/3 local region snapshots. 2023-02-09 16:55:29,684 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/3 local region snapshots. 2023-02-09 16:55:29,687 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 16:55:29,688 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:29,688 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:29,688 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,,1675961720347.964f5813343e8a443a0a9846e8b60a1a. completed. 2023-02-09 16:55:29,688 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,,1675961720347.964f5813343e8a443a0a9846e8b60a1a. 2023-02-09 16:55:29,688 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/3 local region snapshots. 2023-02-09 16:55:29,688 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 3 local region snapshots. 2023-02-09 16:55:29,688 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:29,688 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb-1675961729200' locally completed 2023-02-09 16:55:29,688 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb-1675961729200' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:55:29,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1675961729200 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-09 16:55:29,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1675961729200 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-09 16:55:29,689 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-09 16:55:29,690 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb-1675961729200' has notified controller of completion 2023-02-09 16:55:29,690 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:55:29,690 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1675961729200/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:29,690 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb-1675961729200' completed. 2023-02-09 16:55:29,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb-1675961729200/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:29,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:55:29,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 16:55:29,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:55:29,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:55:29,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1675961729200 2023-02-09 16:55:29,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:29,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:55:29,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1675961729200 2023-02-09 16:55:29,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:29,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb-1675961729200' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:55:29,692 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'snaptb-1675961729200', counting down latch. Waiting for 0 more 2023-02-09 16:55:29,692 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb-1675961729200' execution completed 2023-02-09 16:55:29,693 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:55:29,693 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:55:29,693 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb-1675961729200 2023-02-09 16:55:29,693 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb-1675961729200including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-09 16:55:29,694 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1675961729200 2023-02-09 16:55:29,694 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1675961729200 2023-02-09 16:55:29,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb-1675961729200 2023-02-09 16:55:29,694 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb-1675961729200 2023-02-09 16:55:29,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:55:29,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 16:55:29,694 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 16:55:29,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1675961729200 2023-02-09 16:55:29,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:55:29,695 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 16:55:29,695 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb-1675961729200/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:29,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 16:55:29,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1675961729200 2023-02-09 16:55:29,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1675961729200 2023-02-09 16:55:29,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:55:29,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1675961729200 2023-02-09 16:55:29,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:29,696 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb-1675961729200/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:29,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:55:29,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1675961729200 2023-02-09 16:55:29,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:29,698 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1675961729200/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:29,698 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 16:55:29,698 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1675961729200 2023-02-09 16:55:29,698 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:55:29,698 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb-1675961729200 2023-02-09 16:55:29,698 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 16:55:29,698 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 16:55:29,699 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testCompactionWithHFileLink 2023-02-09 16:55:29,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 16:55:29,698 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1675961729200 2023-02-09 16:55:29,699 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1675961729200/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:29,699 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 0e7b6fa9e81bd62588edd7d77d6165e4, NAME => 'testCompactionWithHFileLink,.mob,0.0e7b6fa9e81bd62588edd7d77d6165e4.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb-1675961729200 2023-02-09 16:55:29,699 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1675961729200 2023-02-09 16:55:29,699 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-02-09 16:55:29,699 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1675961729200 2023-02-09 16:55:29,699 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1675961729200 2023-02-09 16:55:29,699 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 16:55:29,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 16:55:29,700 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023020920cc890cd42446f29aa42a9853cbea21, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023020929b05f21007847e19c056e5dd4865367, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302095021cf77926d4cc381f0f752f0dacf42, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230209a1c3b9e7c7924e958bf64ca5d6182f60, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023020926654af107cf4162ad4745bfa2f1ca26, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302096bcc7efd6cc84d2fbda5375b5938e8be, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302099bcabcbba46349fb98ce3d3b3b7fe317, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230209ecf6c4e2f15a431dba58fdc14222af40, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302090b627555e2784172917cd94efc2d6532, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023020981776dbf549d496f905da8431c141ba1, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230209c06eb6440a0b47869da46e27ce12e759, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230209cdaa8e47ff974e13abc12d6b32848b7f] mob files 2023-02-09 16:55:29,700 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023020920cc890cd42446f29aa42a9853cbea21 2023-02-09 16:55:29,700 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023020929b05f21007847e19c056e5dd4865367 2023-02-09 16:55:29,700 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302095021cf77926d4cc381f0f752f0dacf42 2023-02-09 16:55:29,700 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230209a1c3b9e7c7924e958bf64ca5d6182f60 2023-02-09 16:55:29,700 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023020926654af107cf4162ad4745bfa2f1ca26 2023-02-09 16:55:29,700 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302096bcc7efd6cc84d2fbda5375b5938e8be 2023-02-09 16:55:29,700 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302099bcabcbba46349fb98ce3d3b3b7fe317 2023-02-09 16:55:29,700 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230209ecf6c4e2f15a431dba58fdc14222af40 2023-02-09 16:55:29,700 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302090b627555e2784172917cd94efc2d6532 2023-02-09 16:55:29,700 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023020981776dbf549d496f905da8431c141ba1 2023-02-09 16:55:29,700 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230209c06eb6440a0b47869da46e27ce12e759 2023-02-09 16:55:29,700 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230209cdaa8e47ff974e13abc12d6b32848b7f 2023-02-09 16:55:29,701 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023020982231d331f9c40bf8405b7ee2dca67cc, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230209bce6e987285a4c559249d798dce464ad, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230209cc4b108d971e4a1aa5e627d23ee25a0e, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230209fed187fa50e54366af3a1ed6b3afc793, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302094648339c3a1a4e5bb11592c5c9702e25, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302094930207ceb9141bfa31ba817e12f3a1c, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230209c3380e409fd7453687655309ff29c642, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230209cb92ed45f4cf400d97d85d402d1107e1, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230209112d4355b5014688bf9e143f89d91c07, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230209346859ce7e9a45b1857ee7f3a1bcc69c, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023020979d05d633b5b49d5815baf8c663d8a01, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230209904d495414744a3ebf16ef6e61e5424e] mob files 2023-02-09 16:55:29,701 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023020982231d331f9c40bf8405b7ee2dca67cc 2023-02-09 16:55:29,701 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230209bce6e987285a4c559249d798dce464ad 2023-02-09 16:55:29,701 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230209cc4b108d971e4a1aa5e627d23ee25a0e 2023-02-09 16:55:29,701 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230209fed187fa50e54366af3a1ed6b3afc793 2023-02-09 16:55:29,701 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302094648339c3a1a4e5bb11592c5c9702e25 2023-02-09 16:55:29,702 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302094930207ceb9141bfa31ba817e12f3a1c 2023-02-09 16:55:29,702 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230209c3380e409fd7453687655309ff29c642 2023-02-09 16:55:29,702 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230209cb92ed45f4cf400d97d85d402d1107e1 2023-02-09 16:55:29,702 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230209112d4355b5014688bf9e143f89d91c07 2023-02-09 16:55:29,702 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230209346859ce7e9a45b1857ee7f3a1bcc69c 2023-02-09 16:55:29,702 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023020979d05d633b5b49d5815baf8c663d8a01 2023-02-09 16:55:29,702 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230209904d495414744a3ebf16ef6e61e5424e 2023-02-09 16:55:29,719 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-02-09 16:55:29,989 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 16:55:29,989 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:29,989 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:29,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1675961729200 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-09 16:55:29,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1675961729200 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-09 16:55:29,990 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-09 16:55:30,108 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb-1675961729200 2023-02-09 16:55:30,110 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.hbase-snapshot/.tmp/snaptb-1675961729200 2023-02-09 16:55:30,490 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 16:55:30,490 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:30,490 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:30,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1675961729200 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-09 16:55:30,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1675961729200 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-09 16:55:30,491 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-09 16:55:30,550 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.hbase-snapshot/.tmp/snaptb-1675961729200 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.hbase-snapshot/snaptb-1675961729200 2023-02-09 16:55:31,365 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb-1675961729200 of table testCompactionWithHFileLink completed 2023-02-09 16:55:31,365 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.hbase-snapshot/.tmp/snaptb-1675961729200 2023-02-09 16:55:31,365 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.hbase-snapshot/.tmp/snaptb-1675961729200 2023-02-09 16:55:31,365 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb-1675961729200 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1675961729236Completed referencing HFiles for the mob region of table: testCompactionWithHFileLink at 1675961730108 (+872 ms)Consolidate snapshot: snaptb-1675961729200 at 1675961730108Loading Region manifests for snaptb-1675961729200 at 1675961730108Writing data manifest for snaptb-1675961729200 at 1675961730117 (+9 ms)Verifying snapshot: snaptb-1675961729200 at 1675961730524 (+407 ms)Snapshot snaptb-1675961729200 of table testCompactionWithHFileLink completed at 1675961731365 (+841 ms) 2023-02-09 16:55:31,366 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=87, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-02-09 16:55:31,368 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=87, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED in 2.1280 sec 2023-02-09 16:55:31,491 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 16:55:31,492 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:31,492 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:31,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1675961729200 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-09 16:55:31,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb-1675961729200 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-09 16:55:31,520 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:31,520 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:31,521 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:55:31,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-02-09 16:55:31,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-02-09 16:55:31,523 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-02-09 16:55:31,523 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:55:31,523 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-02-09 16:55:31,523 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-02-09 16:55:31,523 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 16:55:31,523 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-09 16:55:31,525 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:55:31,525 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:31,525 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:55:31,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:55:31,525 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:31,525 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:55:31,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-09 16:55:31,526 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 16:55:31,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:55:31,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-09 16:55:31,526 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-02-09 16:55:31,526 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-02-09 16:55:31,526 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-02-09 16:55:31,526 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:55:31,526 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-02-09 16:55:31,526 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1675961720347.ff109ff5b69a09236d8e26cac06ad183. 2023-02-09 16:55:31,526 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1675961720347.8f50653056db0fc97159c3a723710554. 2023-02-09 16:55:31,526 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1675961720347.ff109ff5b69a09236d8e26cac06ad183. started... 2023-02-09 16:55:31,527 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1675961720347.8f50653056db0fc97159c3a723710554. started... 2023-02-09 16:55:31,527 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing ff109ff5b69a09236d8e26cac06ad183 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-09 16:55:31,527 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 8f50653056db0fc97159c3a723710554 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-09 16:55:31,528 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-09 16:55:31,528 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:55:31,528 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1675961720347.964f5813343e8a443a0a9846e8b60a1a. 2023-02-09 16:55:31,528 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1675961720347.964f5813343e8a443a0a9846e8b60a1a. started... 2023-02-09 16:55:31,528 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 964f5813343e8a443a0a9846e8b60a1a 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-09 16:55:31,548 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/.tmp/family1/b906c3c806a34bc39de41cea613f43c0 2023-02-09 16:55:31,551 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b906c3c806a34bc39de41cea613f43c0 2023-02-09 16:55:32,345 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/.tmp/family1/dc8d58a677b44d09a80959dc906b4208 2023-02-09 16:55:32,345 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/.tmp/family1/7f8808ee56894828a854d6a32c5b95cd 2023-02-09 16:55:32,349 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7f8808ee56894828a854d6a32c5b95cd 2023-02-09 16:55:32,349 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dc8d58a677b44d09a80959dc906b4208 2023-02-09 16:55:32,367 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/.tmp/family2/9d58de1c3e754c6ba0d2301fdad9c894 2023-02-09 16:55:32,370 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9d58de1c3e754c6ba0d2301fdad9c894 2023-02-09 16:55:32,371 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/.tmp/family1/b906c3c806a34bc39de41cea613f43c0 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family1/b906c3c806a34bc39de41cea613f43c0 2023-02-09 16:55:32,374 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b906c3c806a34bc39de41cea613f43c0 2023-02-09 16:55:32,375 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family1/b906c3c806a34bc39de41cea613f43c0, entries=3, sequenceid=24, filesize=5.0 K 2023-02-09 16:55:32,375 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/.tmp/family2/9d58de1c3e754c6ba0d2301fdad9c894 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family2/9d58de1c3e754c6ba0d2301fdad9c894 2023-02-09 16:55:32,379 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9d58de1c3e754c6ba0d2301fdad9c894 2023-02-09 16:55:32,379 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family2/9d58de1c3e754c6ba0d2301fdad9c894, entries=1, sequenceid=24, filesize=5.0 K 2023-02-09 16:55:32,379 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 964f5813343e8a443a0a9846e8b60a1a in 851ms, sequenceid=24, compaction requested=true 2023-02-09 16:55:32,379 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 964f5813343e8a443a0a9846e8b60a1a: 2023-02-09 16:55:32,379 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1675961720347.964f5813343e8a443a0a9846e8b60a1a. 2023-02-09 16:55:32,380 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-09 16:55:33,160 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/.tmp/family2/faa28e345b5a481aa23d47ff838e7840 2023-02-09 16:55:33,163 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/.tmp/family2/dd2e23cf84ae4c049f9bcc6d18fd53cc 2023-02-09 16:55:33,165 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for faa28e345b5a481aa23d47ff838e7840 2023-02-09 16:55:33,165 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/.tmp/family1/dc8d58a677b44d09a80959dc906b4208 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family1/dc8d58a677b44d09a80959dc906b4208 2023-02-09 16:55:33,166 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dd2e23cf84ae4c049f9bcc6d18fd53cc 2023-02-09 16:55:33,167 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/.tmp/family1/7f8808ee56894828a854d6a32c5b95cd as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1/7f8808ee56894828a854d6a32c5b95cd 2023-02-09 16:55:33,169 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dc8d58a677b44d09a80959dc906b4208 2023-02-09 16:55:33,169 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family1/dc8d58a677b44d09a80959dc906b4208, entries=3, sequenceid=24, filesize=5.0 K 2023-02-09 16:55:33,170 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/.tmp/family2/faa28e345b5a481aa23d47ff838e7840 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family2/faa28e345b5a481aa23d47ff838e7840 2023-02-09 16:55:33,170 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7f8808ee56894828a854d6a32c5b95cd 2023-02-09 16:55:33,170 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1/7f8808ee56894828a854d6a32c5b95cd, entries=3, sequenceid=24, filesize=5.0 K 2023-02-09 16:55:33,170 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/.tmp/family2/dd2e23cf84ae4c049f9bcc6d18fd53cc as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family2/dd2e23cf84ae4c049f9bcc6d18fd53cc 2023-02-09 16:55:33,173 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for faa28e345b5a481aa23d47ff838e7840 2023-02-09 16:55:33,173 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family2/faa28e345b5a481aa23d47ff838e7840, entries=1, sequenceid=24, filesize=5.0 K 2023-02-09 16:55:33,174 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dd2e23cf84ae4c049f9bcc6d18fd53cc 2023-02-09 16:55:33,174 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family2/dd2e23cf84ae4c049f9bcc6d18fd53cc, entries=1, sequenceid=24, filesize=5.0 K 2023-02-09 16:55:33,174 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for ff109ff5b69a09236d8e26cac06ad183 in 1647ms, sequenceid=24, compaction requested=true 2023-02-09 16:55:33,174 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for ff109ff5b69a09236d8e26cac06ad183: 2023-02-09 16:55:33,174 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1675961720347.ff109ff5b69a09236d8e26cac06ad183. 2023-02-09 16:55:33,174 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 8f50653056db0fc97159c3a723710554 in 1647ms, sequenceid=24, compaction requested=true 2023-02-09 16:55:33,174 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-09 16:55:33,174 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 8f50653056db0fc97159c3a723710554: 2023-02-09 16:55:33,174 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1675961720347.8f50653056db0fc97159c3a723710554. 2023-02-09 16:55:33,174 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-09 16:55:33,174 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-09 16:55:33,174 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:33,174 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-02-09 16:55:33,174 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-02-09 16:55:33,176 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:33,176 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 16:55:33,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:33,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:55:33,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:55:33,177 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 16:55:33,177 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:55:33,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:55:33,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:55:33,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 16:55:33,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:33,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:55:33,178 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-02-09 16:55:33,178 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-02-09 16:55:33,178 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1c7f41e9[Count = 0] remaining members to acquire global barrier 2023-02-09 16:55:33,178 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 16:55:33,182 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 16:55:33,182 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 16:55:33,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 16:55:33,182 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-02-09 16:55:33,182 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-02-09 16:55:33,182 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:55:33,182 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:33,183 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:55:33,185 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-02-09 16:55:33,185 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:55:33,185 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:33,185 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-02-09 16:55:33,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:33,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:55:33,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:55:33,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:55:33,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:55:33,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 16:55:33,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:33,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:55:33,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 16:55:33,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:33,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:55:33,187 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-02-09 16:55:33,187 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-02-09 16:55:33,187 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:55:33,188 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:55:33,188 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-02-09 16:55:33,188 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:55:33,189 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 16:55:33,189 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 16:55:33,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 16:55:33,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 16:55:33,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:55:33,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:55:33,189 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:55:33,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 16:55:33,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:55:33,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:55:33,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:55:33,189 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:33,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 16:55:33,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 16:55:33,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:55:33,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 16:55:33,191 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:33,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:33,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:55:33,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 16:55:33,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:33,193 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:33,193 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:55:33,193 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-09 16:55:33,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:55:33,193 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-02-09 16:55:33,193 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:55:33,193 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-09 16:55:33,193 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:55:33,193 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:55:33,193 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:33,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:55:33,193 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 16:55:33,193 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 16:55:33,193 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-02-09 16:55:33,193 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 16:55:33,193 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:55:33,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:55:33,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:55:33,293 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:55:33,294 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:33,294 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:33,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:55:33,295 DEBUG [Listener at localhost/41619] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-09 16:55:33,295 DEBUG [Listener at localhost/41619] regionserver.HStore(1912): ff109ff5b69a09236d8e26cac06ad183/family1 is initiating major compaction (all files) 2023-02-09 16:55:33,295 INFO [Listener at localhost/41619] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 16:55:33,295 INFO [Listener at localhost/41619] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 16:55:33,295 INFO [Listener at localhost/41619] regionserver.HRegion(2258): Starting compaction of ff109ff5b69a09236d8e26cac06ad183/family1 in testCompactionWithHFileLink,1,1675961720347.ff109ff5b69a09236d8e26cac06ad183. 2023-02-09 16:55:33,296 INFO [Listener at localhost/41619] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family1/23928677550e4b8d89458a32e18e9063, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family1/803335f8c9474fcf8a2ea08851a991db, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family1/4b47145a05c04482887ccb260167014f, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family1/c9eca6421ae74a5d83702f06efa00d4f, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family1/dc8d58a677b44d09a80959dc906b4208] into tmpdir=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/.tmp, totalSize=26.7 K 2023-02-09 16:55:33,296 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting 23928677550e4b8d89458a32e18e9063, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675961722464 2023-02-09 16:55:33,296 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting 803335f8c9474fcf8a2ea08851a991db, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675961723846 2023-02-09 16:55:33,297 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting 4b47145a05c04482887ccb260167014f, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675961725624 2023-02-09 16:55:33,297 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting c9eca6421ae74a5d83702f06efa00d4f, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675961727415 2023-02-09 16:55:33,297 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting dc8d58a677b44d09a80959dc906b4208, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-09 16:55:33,309 INFO [Listener at localhost/41619] throttle.PressureAwareThroughputController(145): ff109ff5b69a09236d8e26cac06ad183#family1#compaction#108 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 16:55:33,717 INFO [Listener at localhost/41619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023020933152166910d4c51b213b7eccbf28067_del 2023-02-09 16:55:33,717 INFO [Listener at localhost/41619] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023020933152166910d4c51b213b7eccbf28067_del to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023020933152166910d4c51b213b7eccbf28067_del 2023-02-09 16:55:34,530 INFO [Listener at localhost/41619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 834e1a7a0e6b46249e2d94ba8724e509 2023-02-09 16:55:34,530 DEBUG [Listener at localhost/41619] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/.tmp/family1/834e1a7a0e6b46249e2d94ba8724e509 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family1/834e1a7a0e6b46249e2d94ba8724e509 2023-02-09 16:55:34,534 INFO [Listener at localhost/41619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 834e1a7a0e6b46249e2d94ba8724e509 2023-02-09 16:55:34,535 INFO [Listener at localhost/41619] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in ff109ff5b69a09236d8e26cac06ad183/family1 of ff109ff5b69a09236d8e26cac06ad183 into 834e1a7a0e6b46249e2d94ba8724e509(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-09 16:55:34,535 DEBUG [Listener at localhost/41619] regionserver.HRegion(2288): Compaction status journal for ff109ff5b69a09236d8e26cac06ad183: 2023-02-09 16:55:34,535 DEBUG [Listener at localhost/41619] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-09 16:55:34,535 DEBUG [Listener at localhost/41619] regionserver.HStore(1912): ff109ff5b69a09236d8e26cac06ad183/family2 is initiating major compaction (all files) 2023-02-09 16:55:34,535 INFO [Listener at localhost/41619] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 16:55:34,535 INFO [Listener at localhost/41619] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 16:55:34,535 INFO [Listener at localhost/41619] regionserver.HRegion(2258): Starting compaction of ff109ff5b69a09236d8e26cac06ad183/family2 in testCompactionWithHFileLink,1,1675961720347.ff109ff5b69a09236d8e26cac06ad183. 2023-02-09 16:55:34,535 INFO [Listener at localhost/41619] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family2/e1834c7e198d4a5492a909f9090dba11, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family2/cf952d5d378641a494409f4684fd499b, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family2/1339a57e456946d083bc26ef990b55e2, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family2/3a4e6fb98efd4681973e25dee0f08c97, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family2/faa28e345b5a481aa23d47ff838e7840] into tmpdir=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/.tmp, totalSize=25.4 K 2023-02-09 16:55:34,536 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting e1834c7e198d4a5492a909f9090dba11, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675961722464 2023-02-09 16:55:34,536 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting cf952d5d378641a494409f4684fd499b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675961723846 2023-02-09 16:55:34,536 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting 1339a57e456946d083bc26ef990b55e2, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675961725624 2023-02-09 16:55:34,536 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting 3a4e6fb98efd4681973e25dee0f08c97, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675961727415 2023-02-09 16:55:34,537 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting faa28e345b5a481aa23d47ff838e7840, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-09 16:55:34,546 INFO [Listener at localhost/41619] throttle.PressureAwareThroughputController(145): ff109ff5b69a09236d8e26cac06ad183#family2#compaction#109 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 16:55:34,588 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family1/23928677550e4b8d89458a32e18e9063, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family1/803335f8c9474fcf8a2ea08851a991db, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family1/4b47145a05c04482887ccb260167014f, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family1/c9eca6421ae74a5d83702f06efa00d4f, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family1/dc8d58a677b44d09a80959dc906b4208] to archive 2023-02-09 16:55:34,589 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 16:55:34,591 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family1/23928677550e4b8d89458a32e18e9063 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family1/23928677550e4b8d89458a32e18e9063 2023-02-09 16:55:34,591 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family1/803335f8c9474fcf8a2ea08851a991db to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family1/803335f8c9474fcf8a2ea08851a991db 2023-02-09 16:55:34,592 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family1/4b47145a05c04482887ccb260167014f to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family1/4b47145a05c04482887ccb260167014f 2023-02-09 16:55:34,593 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family1/c9eca6421ae74a5d83702f06efa00d4f to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family1/c9eca6421ae74a5d83702f06efa00d4f 2023-02-09 16:55:34,594 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family1/dc8d58a677b44d09a80959dc906b4208 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family1/dc8d58a677b44d09a80959dc906b4208 2023-02-09 16:55:34,955 INFO [Listener at localhost/41619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230209db687be73cba47e494340b23a8a3a941_del 2023-02-09 16:55:34,955 INFO [Listener at localhost/41619] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230209db687be73cba47e494340b23a8a3a941_del to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230209db687be73cba47e494340b23a8a3a941_del 2023-02-09 16:55:35,221 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-09 16:55:35,770 INFO [Listener at localhost/41619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6366fafe8b6644c6a63dc8935c367a9d 2023-02-09 16:55:35,771 DEBUG [Listener at localhost/41619] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/.tmp/family2/6366fafe8b6644c6a63dc8935c367a9d as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family2/6366fafe8b6644c6a63dc8935c367a9d 2023-02-09 16:55:35,774 INFO [Listener at localhost/41619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6366fafe8b6644c6a63dc8935c367a9d 2023-02-09 16:55:35,775 INFO [Listener at localhost/41619] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in ff109ff5b69a09236d8e26cac06ad183/family2 of ff109ff5b69a09236d8e26cac06ad183 into 6366fafe8b6644c6a63dc8935c367a9d(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-09 16:55:35,775 DEBUG [Listener at localhost/41619] regionserver.HRegion(2288): Compaction status journal for ff109ff5b69a09236d8e26cac06ad183: 2023-02-09 16:55:35,775 DEBUG [Listener at localhost/41619] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-09 16:55:35,775 DEBUG [Listener at localhost/41619] regionserver.HStore(1912): 8f50653056db0fc97159c3a723710554/family1 is initiating major compaction (all files) 2023-02-09 16:55:35,775 INFO [Listener at localhost/41619] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 16:55:35,775 INFO [Listener at localhost/41619] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 16:55:35,775 INFO [Listener at localhost/41619] regionserver.HRegion(2258): Starting compaction of 8f50653056db0fc97159c3a723710554/family1 in testCompactionWithHFileLink,2,1675961720347.8f50653056db0fc97159c3a723710554. 2023-02-09 16:55:35,775 INFO [Listener at localhost/41619] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1/9960ca25ee884e899d44d73e77321d91, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1/bbd66b2a75854d769f68ec967526f8e4, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1/95fe8fee4073477c8d575821319f6012, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1/b5696cb1277d4b3f9d2aaf063efb7dbd, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1/7f8808ee56894828a854d6a32c5b95cd] into tmpdir=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/.tmp, totalSize=26.7 K 2023-02-09 16:55:35,776 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting 9960ca25ee884e899d44d73e77321d91, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675961722465 2023-02-09 16:55:35,776 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting bbd66b2a75854d769f68ec967526f8e4, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675961723846 2023-02-09 16:55:35,776 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting 95fe8fee4073477c8d575821319f6012, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675961725624 2023-02-09 16:55:35,776 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting b5696cb1277d4b3f9d2aaf063efb7dbd, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675961727415 2023-02-09 16:55:35,777 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting 7f8808ee56894828a854d6a32c5b95cd, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-09 16:55:35,785 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family2/e1834c7e198d4a5492a909f9090dba11, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family2/cf952d5d378641a494409f4684fd499b, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family2/1339a57e456946d083bc26ef990b55e2, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family2/3a4e6fb98efd4681973e25dee0f08c97, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family2/faa28e345b5a481aa23d47ff838e7840] to archive 2023-02-09 16:55:35,785 INFO [Listener at localhost/41619] throttle.PressureAwareThroughputController(145): 8f50653056db0fc97159c3a723710554#family1#compaction#110 average throughput is 0.85 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 16:55:35,786 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 16:55:35,787 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family2/e1834c7e198d4a5492a909f9090dba11 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family2/e1834c7e198d4a5492a909f9090dba11 2023-02-09 16:55:35,788 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family2/cf952d5d378641a494409f4684fd499b to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family2/cf952d5d378641a494409f4684fd499b 2023-02-09 16:55:35,789 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family2/1339a57e456946d083bc26ef990b55e2 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family2/1339a57e456946d083bc26ef990b55e2 2023-02-09 16:55:35,790 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family2/3a4e6fb98efd4681973e25dee0f08c97 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family2/3a4e6fb98efd4681973e25dee0f08c97 2023-02-09 16:55:35,791 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family2/faa28e345b5a481aa23d47ff838e7840 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family2/faa28e345b5a481aa23d47ff838e7840 2023-02-09 16:55:36,193 INFO [Listener at localhost/41619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230209d4f7028a0018498b91c56d74c125455d_del 2023-02-09 16:55:36,194 INFO [Listener at localhost/41619] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230209d4f7028a0018498b91c56d74c125455d_del to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230209d4f7028a0018498b91c56d74c125455d_del 2023-02-09 16:55:37,007 INFO [Listener at localhost/41619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7a0b18c051f247cfb601d2a92de447c7 2023-02-09 16:55:37,008 DEBUG [Listener at localhost/41619] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/.tmp/family1/7a0b18c051f247cfb601d2a92de447c7 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1/7a0b18c051f247cfb601d2a92de447c7 2023-02-09 16:55:37,011 INFO [Listener at localhost/41619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7a0b18c051f247cfb601d2a92de447c7 2023-02-09 16:55:37,012 INFO [Listener at localhost/41619] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 8f50653056db0fc97159c3a723710554/family1 of 8f50653056db0fc97159c3a723710554 into 7a0b18c051f247cfb601d2a92de447c7(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-09 16:55:37,012 DEBUG [Listener at localhost/41619] regionserver.HRegion(2288): Compaction status journal for 8f50653056db0fc97159c3a723710554: 2023-02-09 16:55:37,012 DEBUG [Listener at localhost/41619] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-09 16:55:37,013 DEBUG [Listener at localhost/41619] regionserver.HStore(1912): 8f50653056db0fc97159c3a723710554/family2 is initiating major compaction (all files) 2023-02-09 16:55:37,013 INFO [Listener at localhost/41619] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 16:55:37,013 INFO [Listener at localhost/41619] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 16:55:37,013 INFO [Listener at localhost/41619] regionserver.HRegion(2258): Starting compaction of 8f50653056db0fc97159c3a723710554/family2 in testCompactionWithHFileLink,2,1675961720347.8f50653056db0fc97159c3a723710554. 2023-02-09 16:55:37,013 INFO [Listener at localhost/41619] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family2/83269f5b6253457b801063cde566d9a5, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family2/253a38900d1948339df6cb97b5c85255, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family2/2b4aaa427870487695f27db022840756, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family2/1c3a8a6e6ea44571b8fda362269e1731, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family2/dd2e23cf84ae4c049f9bcc6d18fd53cc] into tmpdir=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/.tmp, totalSize=25.4 K 2023-02-09 16:55:37,013 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting 83269f5b6253457b801063cde566d9a5, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675961722465 2023-02-09 16:55:37,014 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting 253a38900d1948339df6cb97b5c85255, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675961723846 2023-02-09 16:55:37,014 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting 2b4aaa427870487695f27db022840756, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675961725624 2023-02-09 16:55:37,014 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting 1c3a8a6e6ea44571b8fda362269e1731, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675961727415 2023-02-09 16:55:37,014 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting dd2e23cf84ae4c049f9bcc6d18fd53cc, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-09 16:55:37,024 INFO [Listener at localhost/41619] throttle.PressureAwareThroughputController(145): 8f50653056db0fc97159c3a723710554#family2#compaction#111 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 16:55:37,090 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1/9960ca25ee884e899d44d73e77321d91, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1/bbd66b2a75854d769f68ec967526f8e4, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1/95fe8fee4073477c8d575821319f6012, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1/b5696cb1277d4b3f9d2aaf063efb7dbd, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1/7f8808ee56894828a854d6a32c5b95cd] to archive 2023-02-09 16:55:37,091 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 16:55:37,093 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1/9960ca25ee884e899d44d73e77321d91 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1/9960ca25ee884e899d44d73e77321d91 2023-02-09 16:55:37,094 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1/bbd66b2a75854d769f68ec967526f8e4 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1/bbd66b2a75854d769f68ec967526f8e4 2023-02-09 16:55:37,095 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1/95fe8fee4073477c8d575821319f6012 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1/95fe8fee4073477c8d575821319f6012 2023-02-09 16:55:37,096 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1/b5696cb1277d4b3f9d2aaf063efb7dbd to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1/b5696cb1277d4b3f9d2aaf063efb7dbd 2023-02-09 16:55:37,097 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1/7f8808ee56894828a854d6a32c5b95cd to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1/7f8808ee56894828a854d6a32c5b95cd 2023-02-09 16:55:37,432 INFO [Listener at localhost/41619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023020955420b67ebc8477bac67fc9516cb0de2_del 2023-02-09 16:55:37,432 INFO [Listener at localhost/41619] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023020955420b67ebc8477bac67fc9516cb0de2_del to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023020955420b67ebc8477bac67fc9516cb0de2_del 2023-02-09 16:55:38,245 INFO [Listener at localhost/41619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 46bea0892b53463ba538e4f51b9a182a 2023-02-09 16:55:38,246 DEBUG [Listener at localhost/41619] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/.tmp/family2/46bea0892b53463ba538e4f51b9a182a as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family2/46bea0892b53463ba538e4f51b9a182a 2023-02-09 16:55:38,249 INFO [Listener at localhost/41619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 46bea0892b53463ba538e4f51b9a182a 2023-02-09 16:55:38,250 INFO [Listener at localhost/41619] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 8f50653056db0fc97159c3a723710554/family2 of 8f50653056db0fc97159c3a723710554 into 46bea0892b53463ba538e4f51b9a182a(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-09 16:55:38,250 DEBUG [Listener at localhost/41619] regionserver.HRegion(2288): Compaction status journal for 8f50653056db0fc97159c3a723710554: 2023-02-09 16:55:38,250 DEBUG [Listener at localhost/41619] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-09 16:55:38,250 DEBUG [Listener at localhost/41619] regionserver.HStore(1912): 964f5813343e8a443a0a9846e8b60a1a/family1 is initiating major compaction (all files) 2023-02-09 16:55:38,250 INFO [Listener at localhost/41619] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 16:55:38,250 INFO [Listener at localhost/41619] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 16:55:38,251 INFO [Listener at localhost/41619] regionserver.HRegion(2258): Starting compaction of 964f5813343e8a443a0a9846e8b60a1a/family1 in testCompactionWithHFileLink,,1675961720347.964f5813343e8a443a0a9846e8b60a1a. 2023-02-09 16:55:38,251 INFO [Listener at localhost/41619] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family1/cdc0da56512c47e9905d91d398ff9cee, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family1/2040a0c0d6b74a2a84f36b91f50ba877, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family1/91b9b6b408b346eebf03b112c14765f1, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family1/2f43f0ba911c4f1daa2bfa44de772d28, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family1/b906c3c806a34bc39de41cea613f43c0] into tmpdir=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/.tmp, totalSize=26.7 K 2023-02-09 16:55:38,251 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting cdc0da56512c47e9905d91d398ff9cee, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675961722463 2023-02-09 16:55:38,251 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting 2040a0c0d6b74a2a84f36b91f50ba877, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675961723846 2023-02-09 16:55:38,252 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting 91b9b6b408b346eebf03b112c14765f1, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675961725623 2023-02-09 16:55:38,252 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting 2f43f0ba911c4f1daa2bfa44de772d28, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675961727415 2023-02-09 16:55:38,252 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting b906c3c806a34bc39de41cea613f43c0, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-09 16:55:38,263 INFO [Listener at localhost/41619] throttle.PressureAwareThroughputController(145): 964f5813343e8a443a0a9846e8b60a1a#family1#compaction#112 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 16:55:38,288 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family2/83269f5b6253457b801063cde566d9a5, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family2/253a38900d1948339df6cb97b5c85255, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family2/2b4aaa427870487695f27db022840756, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family2/1c3a8a6e6ea44571b8fda362269e1731, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family2/dd2e23cf84ae4c049f9bcc6d18fd53cc] to archive 2023-02-09 16:55:38,289 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 16:55:38,290 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family2/83269f5b6253457b801063cde566d9a5 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family2/83269f5b6253457b801063cde566d9a5 2023-02-09 16:55:38,291 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family2/253a38900d1948339df6cb97b5c85255 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family2/253a38900d1948339df6cb97b5c85255 2023-02-09 16:55:38,292 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family2/2b4aaa427870487695f27db022840756 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family2/2b4aaa427870487695f27db022840756 2023-02-09 16:55:38,293 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family2/1c3a8a6e6ea44571b8fda362269e1731 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family2/1c3a8a6e6ea44571b8fda362269e1731 2023-02-09 16:55:38,294 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family2/dd2e23cf84ae4c049f9bcc6d18fd53cc to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family2/dd2e23cf84ae4c049f9bcc6d18fd53cc 2023-02-09 16:55:38,670 INFO [Listener at localhost/41619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202302097861984dbf2e494c948d09531dacebfa_del 2023-02-09 16:55:38,671 INFO [Listener at localhost/41619] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302097861984dbf2e494c948d09531dacebfa_del to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302097861984dbf2e494c948d09531dacebfa_del 2023-02-09 16:55:39,484 INFO [Listener at localhost/41619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5aa712a0b006493fb690b864d8b0e7a3 2023-02-09 16:55:39,485 DEBUG [Listener at localhost/41619] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/.tmp/family1/5aa712a0b006493fb690b864d8b0e7a3 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family1/5aa712a0b006493fb690b864d8b0e7a3 2023-02-09 16:55:39,488 INFO [Listener at localhost/41619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5aa712a0b006493fb690b864d8b0e7a3 2023-02-09 16:55:39,489 INFO [Listener at localhost/41619] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 964f5813343e8a443a0a9846e8b60a1a/family1 of 964f5813343e8a443a0a9846e8b60a1a into 5aa712a0b006493fb690b864d8b0e7a3(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-09 16:55:39,489 DEBUG [Listener at localhost/41619] regionserver.HRegion(2288): Compaction status journal for 964f5813343e8a443a0a9846e8b60a1a: 2023-02-09 16:55:39,489 DEBUG [Listener at localhost/41619] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-09 16:55:39,489 DEBUG [Listener at localhost/41619] regionserver.HStore(1912): 964f5813343e8a443a0a9846e8b60a1a/family2 is initiating major compaction (all files) 2023-02-09 16:55:39,489 INFO [Listener at localhost/41619] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 16:55:39,489 INFO [Listener at localhost/41619] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 16:55:39,489 INFO [Listener at localhost/41619] regionserver.HRegion(2258): Starting compaction of 964f5813343e8a443a0a9846e8b60a1a/family2 in testCompactionWithHFileLink,,1675961720347.964f5813343e8a443a0a9846e8b60a1a. 2023-02-09 16:55:39,490 INFO [Listener at localhost/41619] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family2/6a91dabe164b468b8eb198799372a729, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family2/61d7c5d467734196aaf47bb8a75ee866, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family2/41872818fa124596bdceeb9e4d43509d, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family2/6c223c6d2b8747279825b472ebbe3b88, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family2/9d58de1c3e754c6ba0d2301fdad9c894] into tmpdir=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/.tmp, totalSize=25.4 K 2023-02-09 16:55:39,490 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting 6a91dabe164b468b8eb198799372a729, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675961722463 2023-02-09 16:55:39,490 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting 61d7c5d467734196aaf47bb8a75ee866, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675961723846 2023-02-09 16:55:39,491 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting 41872818fa124596bdceeb9e4d43509d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675961725623 2023-02-09 16:55:39,491 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting 6c223c6d2b8747279825b472ebbe3b88, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675961727415 2023-02-09 16:55:39,491 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting 9d58de1c3e754c6ba0d2301fdad9c894, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-09 16:55:39,491 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family1/cdc0da56512c47e9905d91d398ff9cee, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family1/2040a0c0d6b74a2a84f36b91f50ba877, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family1/91b9b6b408b346eebf03b112c14765f1, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family1/2f43f0ba911c4f1daa2bfa44de772d28, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family1/b906c3c806a34bc39de41cea613f43c0] to archive 2023-02-09 16:55:39,492 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 16:55:39,496 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family1/cdc0da56512c47e9905d91d398ff9cee to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family1/cdc0da56512c47e9905d91d398ff9cee 2023-02-09 16:55:39,497 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family1/2040a0c0d6b74a2a84f36b91f50ba877 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family1/2040a0c0d6b74a2a84f36b91f50ba877 2023-02-09 16:55:39,498 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family1/91b9b6b408b346eebf03b112c14765f1 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family1/91b9b6b408b346eebf03b112c14765f1 2023-02-09 16:55:39,499 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family1/2f43f0ba911c4f1daa2bfa44de772d28 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family1/2f43f0ba911c4f1daa2bfa44de772d28 2023-02-09 16:55:39,501 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family1/b906c3c806a34bc39de41cea613f43c0 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family1/b906c3c806a34bc39de41cea613f43c0 2023-02-09 16:55:39,505 INFO [Listener at localhost/41619] throttle.PressureAwareThroughputController(145): 964f5813343e8a443a0a9846e8b60a1a#family2#compaction#113 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 16:55:39,913 INFO [Listener at localhost/41619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202302092e3daad91766434db0eefe9d294d67e9_del 2023-02-09 16:55:39,913 INFO [Listener at localhost/41619] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302092e3daad91766434db0eefe9d294d67e9_del to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302092e3daad91766434db0eefe9d294d67e9_del 2023-02-09 16:55:40,327 INFO [Listener at localhost/41619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 45b89674170e487f98094d4ef060f8cd 2023-02-09 16:55:40,327 DEBUG [Listener at localhost/41619] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/.tmp/family2/45b89674170e487f98094d4ef060f8cd as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family2/45b89674170e487f98094d4ef060f8cd 2023-02-09 16:55:40,331 INFO [Listener at localhost/41619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 45b89674170e487f98094d4ef060f8cd 2023-02-09 16:55:40,331 INFO [Listener at localhost/41619] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 964f5813343e8a443a0a9846e8b60a1a/family2 of 964f5813343e8a443a0a9846e8b60a1a into 45b89674170e487f98094d4ef060f8cd(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-09 16:55:40,331 DEBUG [Listener at localhost/41619] regionserver.HRegion(2288): Compaction status journal for 964f5813343e8a443a0a9846e8b60a1a: 2023-02-09 16:55:40,337 DEBUG [Listener at localhost/41619] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-09 16:55:40,341 DEBUG [Listener at localhost/41619] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-09 16:55:40,345 DEBUG [Listener at localhost/41619] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-09 16:55:40,346 DEBUG [Listener at localhost/41619] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-09 16:55:40,351 INFO [Listener at localhost/41619] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-09 16:55:40,382 INFO [Listener at localhost/41619] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-02-09 16:55:40,385 INFO [Listener at localhost/41619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202302097861984dbf2e494c948d09531dacebfa_del 2023-02-09 16:55:40,386 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family2/6a91dabe164b468b8eb198799372a729, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family2/61d7c5d467734196aaf47bb8a75ee866, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family2/41872818fa124596bdceeb9e4d43509d, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family2/6c223c6d2b8747279825b472ebbe3b88, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family2/9d58de1c3e754c6ba0d2301fdad9c894] to archive 2023-02-09 16:55:40,386 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 16:55:40,388 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family2/6a91dabe164b468b8eb198799372a729 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family2/6a91dabe164b468b8eb198799372a729 2023-02-09 16:55:40,388 INFO [Listener at localhost/41619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023020933152166910d4c51b213b7eccbf28067_del 2023-02-09 16:55:40,389 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family2/61d7c5d467734196aaf47bb8a75ee866 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family2/61d7c5d467734196aaf47bb8a75ee866 2023-02-09 16:55:40,390 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family2/41872818fa124596bdceeb9e4d43509d to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family2/41872818fa124596bdceeb9e4d43509d 2023-02-09 16:55:40,391 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family2/6c223c6d2b8747279825b472ebbe3b88 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family2/6c223c6d2b8747279825b472ebbe3b88 2023-02-09 16:55:40,392 INFO [Listener at localhost/41619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230209d4f7028a0018498b91c56d74c125455d_del 2023-02-09 16:55:40,392 INFO [Listener at localhost/41619] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testCompactionWithHFileLink' column='family1' 2023-02-09 16:55:40,392 DEBUG [Listener at localhost/41619] zookeeper.ReadOnlyZKClient(139): Connect 0x0df24af2 to 127.0.0.1:53887 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 16:55:40,392 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family2/9d58de1c3e754c6ba0d2301fdad9c894 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family2/9d58de1c3e754c6ba0d2301fdad9c894 2023-02-09 16:55:40,397 DEBUG [Listener at localhost/41619] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@578ad21d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 16:55:40,397 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230209 for table='testCompactionWithHFileLink' and column='family1' 2023-02-09 16:55:40,398 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230209 for table='testCompactionWithHFileLink' and column='family1' 2023-02-09 16:55:40,398 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230209 for table='testCompactionWithHFileLink' and column='family1' 2023-02-09 16:55:41,255 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302099d3b323dbf824a769bc6e94663bf1fd0 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302099d3b323dbf824a769bc6e94663bf1fd0 2023-02-09 16:55:41,256 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230209e455246dac744652bdb51ee7c98052e9 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230209e455246dac744652bdb51ee7c98052e9 2023-02-09 16:55:41,256 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230209109fcd442a4e415abf3f337065e31e2f to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230209109fcd442a4e415abf3f337065e31e2f 2023-02-09 16:55:41,267 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230209 table='testCompactionWithHFileLink' column='family1' 2023-02-09 16:55:41,267 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230209 table='testCompactionWithHFileLink' column='family1' 2023-02-09 16:55:41,267 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230209 table='testCompactionWithHFileLink' column='family1' 2023-02-09 16:55:41,282 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 16:55:41,287 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42802, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 16:55:41,293 INFO [MobFileCompactionChore-pool-1] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:41,293 INFO [MobFileCompactionChore-pool-1] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:41,293 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-09 16:55:41,298 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56954, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-09 16:55:41,301 INFO [MobFileCompactionChore-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:41,301 INFO [MobFileCompactionChore-pool-0] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:41,301 INFO [MobFileCompactionChore-pool-2] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:41,301 INFO [MobFileCompactionChore-pool-2] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:41,316 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230209/family1/5e96df35950b4298ad62c15bccd602c3 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-02-09 16:55:41,316 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230209/family1/93c887d8ee6649249397dcd8deced26e first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-02-09 16:55:41,318 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,2,1675961720347.8f50653056db0fc97159c3a723710554., hostname=jenkins-hbase4.apache.org,35511,1675961620699, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230209/family1/5e96df35950b4298ad62c15bccd602c3}] 2023-02-09 16:55:41,318 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,,1675961720347.964f5813343e8a443a0a9846e8b60a1a., hostname=jenkins-hbase4.apache.org,35511,1675961620699, seqNum=2 for row with hfile group [{family1,hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230209/family1/93c887d8ee6649249397dcd8deced26e}] 2023-02-09 16:55:41,320 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230209/family1/435434ed27cf4d21a01df29bb3185fef first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-02-09 16:55:41,320 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,1,1675961720347.ff109ff5b69a09236d8e26cac06ad183., hostname=jenkins-hbase4.apache.org,35511,1675961620699, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230209/family1/435434ed27cf4d21a01df29bb3185fef}] 2023-02-09 16:55:41,326 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35511] regionserver.HStore(763): Validating hfile at hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230209/family1/93c887d8ee6649249397dcd8deced26e for inclusion in 964f5813343e8a443a0a9846e8b60a1a/family1 2023-02-09 16:55:41,326 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(763): Validating hfile at hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230209/family1/435434ed27cf4d21a01df29bb3185fef for inclusion in ff109ff5b69a09236d8e26cac06ad183/family1 2023-02-09 16:55:41,326 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.HStore(763): Validating hfile at hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230209/family1/5e96df35950b4298ad62c15bccd602c3 for inclusion in 8f50653056db0fc97159c3a723710554/family1 2023-02-09 16:55:41,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-02-09 16:55:41,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(777): Region bounds: first=1 last=2 2023-02-09 16:55:41,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HRegion(2445): Flush status journal for ff109ff5b69a09236d8e26cac06ad183: 2023-02-09 16:55:41,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35511] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-02-09 16:55:41,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-02-09 16:55:41,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.HStore(777): Region bounds: first=2 last= 2023-02-09 16:55:41,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35511] regionserver.HStore(777): Region bounds: first= last=1 2023-02-09 16:55:41,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.HRegion(2445): Flush status journal for 8f50653056db0fc97159c3a723710554: 2023-02-09 16:55:41,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35511] regionserver.HRegion(2445): Flush status journal for 964f5813343e8a443a0a9846e8b60a1a: 2023-02-09 16:55:41,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230209/family1/435434ed27cf4d21a01df29bb3185fef to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testCompactionWithHFileLink__okbriv3a6vm4ae5g1vg5ii8kdficb4hkeccg5fumank0206rgnd0g186gtc4pg67/family1/435434ed27cf4d21a01df29bb3185fef 2023-02-09 16:55:41,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35511] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230209/family1/93c887d8ee6649249397dcd8deced26e to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testCompactionWithHFileLink__cetuj7oi2at8vuno7ti4h3epv3gar7nb84mij7oeolv3olgkhlh6aihqthffpq8k/family1/93c887d8ee6649249397dcd8deced26e 2023-02-09 16:55:41,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230209/family1/5e96df35950b4298ad62c15bccd602c3 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testCompactionWithHFileLink__efgn4hgcgop6v0ia4taf7843pie7f8ffmi43i55u9h0m0mf68ftd9e8jvsgpk86q/family1/5e96df35950b4298ad62c15bccd602c3 2023-02-09 16:55:41,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35511] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testCompactionWithHFileLink__cetuj7oi2at8vuno7ti4h3epv3gar7nb84mij7oeolv3olgkhlh6aihqthffpq8k/family1/93c887d8ee6649249397dcd8deced26e as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family1/5caccad1a6a44c3b8df01548a0a3476e_SeqId_29_ 2023-02-09 16:55:41,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testCompactionWithHFileLink__okbriv3a6vm4ae5g1vg5ii8kdficb4hkeccg5fumank0206rgnd0g186gtc4pg67/family1/435434ed27cf4d21a01df29bb3185fef as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family1/668d307d54fb4bcebc1ca0368c8aec43_SeqId_29_ 2023-02-09 16:55:41,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testCompactionWithHFileLink__efgn4hgcgop6v0ia4taf7843pie7f8ffmi43i55u9h0m0mf68ftd9e8jvsgpk86q/family1/5e96df35950b4298ad62c15bccd602c3 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1/5cd71a405530442898614d53b129a812_SeqId_29_ 2023-02-09 16:55:41,338 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35511] regionserver.HStore(849): Loaded HFile hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testCompactionWithHFileLink__cetuj7oi2at8vuno7ti4h3epv3gar7nb84mij7oeolv3olgkhlh6aihqthffpq8k/family1/93c887d8ee6649249397dcd8deced26e into 964f5813343e8a443a0a9846e8b60a1a/family1 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family1/5caccad1a6a44c3b8df01548a0a3476e_SeqId_29_ - updating store file list. 2023-02-09 16:55:41,338 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(849): Loaded HFile hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testCompactionWithHFileLink__okbriv3a6vm4ae5g1vg5ii8kdficb4hkeccg5fumank0206rgnd0g186gtc4pg67/family1/435434ed27cf4d21a01df29bb3185fef into ff109ff5b69a09236d8e26cac06ad183/family1 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family1/668d307d54fb4bcebc1ca0368c8aec43_SeqId_29_ - updating store file list. 2023-02-09 16:55:41,338 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.HStore(849): Loaded HFile hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testCompactionWithHFileLink__efgn4hgcgop6v0ia4taf7843pie7f8ffmi43i55u9h0m0mf68ftd9e8jvsgpk86q/family1/5e96df35950b4298ad62c15bccd602c3 into 8f50653056db0fc97159c3a723710554/family1 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1/5cd71a405530442898614d53b129a812_SeqId_29_ - updating store file list. 2023-02-09 16:55:41,343 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(882): Loaded HFile hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family1/668d307d54fb4bcebc1ca0368c8aec43_SeqId_29_ into ff109ff5b69a09236d8e26cac06ad183/family1 2023-02-09 16:55:41,343 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(855): Successfully loaded hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testCompactionWithHFileLink__okbriv3a6vm4ae5g1vg5ii8kdficb4hkeccg5fumank0206rgnd0g186gtc4pg67/family1/435434ed27cf4d21a01df29bb3185fef into ff109ff5b69a09236d8e26cac06ad183/family1 (new location: hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family1/668d307d54fb4bcebc1ca0368c8aec43_SeqId_29_) 2023-02-09 16:55:41,343 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.HStore(882): Loaded HFile hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1/5cd71a405530442898614d53b129a812_SeqId_29_ into 8f50653056db0fc97159c3a723710554/family1 2023-02-09 16:55:41,343 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.HStore(855): Successfully loaded hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testCompactionWithHFileLink__efgn4hgcgop6v0ia4taf7843pie7f8ffmi43i55u9h0m0mf68ftd9e8jvsgpk86q/family1/5e96df35950b4298ad62c15bccd602c3 into 8f50653056db0fc97159c3a723710554/family1 (new location: hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1/5cd71a405530442898614d53b129a812_SeqId_29_) 2023-02-09 16:55:41,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testCompactionWithHFileLink__okbriv3a6vm4ae5g1vg5ii8kdficb4hkeccg5fumank0206rgnd0g186gtc4pg67/family1/435434ed27cf4d21a01df29bb3185fef 2023-02-09 16:55:41,344 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35511] regionserver.HStore(882): Loaded HFile hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family1/5caccad1a6a44c3b8df01548a0a3476e_SeqId_29_ into 964f5813343e8a443a0a9846e8b60a1a/family1 2023-02-09 16:55:41,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testCompactionWithHFileLink__efgn4hgcgop6v0ia4taf7843pie7f8ffmi43i55u9h0m0mf68ftd9e8jvsgpk86q/family1/5e96df35950b4298ad62c15bccd602c3 2023-02-09 16:55:41,344 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35511] regionserver.HStore(855): Successfully loaded hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testCompactionWithHFileLink__cetuj7oi2at8vuno7ti4h3epv3gar7nb84mij7oeolv3olgkhlh6aihqthffpq8k/family1/93c887d8ee6649249397dcd8deced26e into 964f5813343e8a443a0a9846e8b60a1a/family1 (new location: hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family1/5caccad1a6a44c3b8df01548a0a3476e_SeqId_29_) 2023-02-09 16:55:41,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35511] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testCompactionWithHFileLink__cetuj7oi2at8vuno7ti4h3epv3gar7nb84mij7oeolv3olgkhlh6aihqthffpq8k/family1/93c887d8ee6649249397dcd8deced26e 2023-02-09 16:55:41,346 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230209 table='testCompactionWithHFileLink' column='family1' 2023-02-09 16:55:41,346 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230209 table='testCompactionWithHFileLink' column='family1' 2023-02-09 16:55:41,347 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 16:55:41,348 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 16:55:41,348 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230209 table='testCompactionWithHFileLink' column='family1' 2023-02-09 16:55:41,349 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023020926654af107cf4162ad4745bfa2f1ca26 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023020926654af107cf4162ad4745bfa2f1ca26 2023-02-09 16:55:41,349 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 16:55:41,350 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023020920cc890cd42446f29aa42a9853cbea21 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023020920cc890cd42446f29aa42a9853cbea21 2023-02-09 16:55:41,350 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302096bcc7efd6cc84d2fbda5375b5938e8be to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302096bcc7efd6cc84d2fbda5375b5938e8be 2023-02-09 16:55:41,350 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302090b627555e2784172917cd94efc2d6532 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302090b627555e2784172917cd94efc2d6532 2023-02-09 16:55:41,351 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023020929b05f21007847e19c056e5dd4865367 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023020929b05f21007847e19c056e5dd4865367 2023-02-09 16:55:41,351 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302099bcabcbba46349fb98ce3d3b3b7fe317 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302099bcabcbba46349fb98ce3d3b3b7fe317 2023-02-09 16:55:41,355 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023020981776dbf549d496f905da8431c141ba1 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023020981776dbf549d496f905da8431c141ba1 2023-02-09 16:55:41,355 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230209ecf6c4e2f15a431dba58fdc14222af40 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230209ecf6c4e2f15a431dba58fdc14222af40 2023-02-09 16:55:41,355 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-09 16:55:41,355 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230209' 2023-02-09 16:55:41,355 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302095021cf77926d4cc381f0f752f0dacf42 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302095021cf77926d4cc381f0f752f0dacf42 2023-02-09 16:55:41,356 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230209 for table='testCompactionWithHFileLink' and column='family1' 2023-02-09 16:55:41,356 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230209c06eb6440a0b47869da46e27ce12e759 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230209c06eb6440a0b47869da46e27ce12e759 2023-02-09 16:55:41,357 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230209a1c3b9e7c7924e958bf64ca5d6182f60 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230209a1c3b9e7c7924e958bf64ca5d6182f60 2023-02-09 16:55:41,357 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-09 16:55:41,357 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230209' 2023-02-09 16:55:41,357 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230209 for table='testCompactionWithHFileLink' and column='family1' 2023-02-09 16:55:41,358 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230209cdaa8e47ff974e13abc12d6b32848b7f to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230209cdaa8e47ff974e13abc12d6b32848b7f 2023-02-09 16:55:41,358 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-09 16:55:41,358 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230209' 2023-02-09 16:55:41,358 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230209 for table='testCompactionWithHFileLink' and column='family1' 2023-02-09 16:55:41,358 INFO [Listener at localhost/41619] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-02-09 16:55:41,358 INFO [Listener at localhost/41619] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testCompactionWithHFileLink' and column='family1' 2023-02-09 16:55:41,358 INFO [Listener at localhost/41619] compactions.PartitionedMobCompactor(367): [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302097861984dbf2e494c948d09531dacebfa_del] 2023-02-09 16:55:41,359 DEBUG [Listener at localhost/41619] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 16:55:41,360 DEBUG [Listener at localhost/41619] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302097861984dbf2e494c948d09531dacebfa_del to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302097861984dbf2e494c948d09531dacebfa_del 2023-02-09 16:55:41,360 INFO [Listener at localhost/41619] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-02-09 16:55:41,360 INFO [Listener at localhost/41619] compactions.PartitionedMobCompactor(367): [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023020933152166910d4c51b213b7eccbf28067_del] 2023-02-09 16:55:41,361 DEBUG [Listener at localhost/41619] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 16:55:41,362 DEBUG [Listener at localhost/41619] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023020933152166910d4c51b213b7eccbf28067_del to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023020933152166910d4c51b213b7eccbf28067_del 2023-02-09 16:55:41,362 INFO [Listener at localhost/41619] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-02-09 16:55:41,362 INFO [Listener at localhost/41619] compactions.PartitionedMobCompactor(367): [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230209d4f7028a0018498b91c56d74c125455d_del] 2023-02-09 16:55:41,362 DEBUG [Listener at localhost/41619] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 16:55:41,363 DEBUG [Listener at localhost/41619] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230209d4f7028a0018498b91c56d74c125455d_del to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230209d4f7028a0018498b91c56d74c125455d_del 2023-02-09 16:55:41,364 INFO [Listener at localhost/41619] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-02-09 16:55:41,367 DEBUG [Listener at localhost/41619] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-09 16:55:41,369 DEBUG [Listener at localhost/41619] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-09 16:55:41,373 DEBUG [Listener at localhost/41619] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-09 16:55:41,374 DEBUG [Listener at localhost/41619] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-09 16:55:41,380 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:41,380 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:41,381 INFO [Listener at localhost/41619] client.HBaseAdmin$15(890): Started disable of testCompactionWithHFileLink 2023-02-09 16:55:41,381 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testCompactionWithHFileLink 2023-02-09 16:55:41,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure2.ProcedureExecutor(1029): Stored pid=88, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testCompactionWithHFileLink 2023-02-09 16:55:41,384 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:41,384 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:41,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-02-09 16:55:41,385 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675961741385"}]},"ts":"1675961741385"} 2023-02-09 16:55:41,386 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLING in hbase:meta 2023-02-09 16:55:41,388 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testCompactionWithHFileLink to state=DISABLING 2023-02-09 16:55:41,389 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=964f5813343e8a443a0a9846e8b60a1a, UNASSIGN}, {pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=ff109ff5b69a09236d8e26cac06ad183, UNASSIGN}, {pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=8f50653056db0fc97159c3a723710554, UNASSIGN}] 2023-02-09 16:55:41,391 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=ff109ff5b69a09236d8e26cac06ad183, UNASSIGN 2023-02-09 16:55:41,391 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=8f50653056db0fc97159c3a723710554, UNASSIGN 2023-02-09 16:55:41,391 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=964f5813343e8a443a0a9846e8b60a1a, UNASSIGN 2023-02-09 16:55:41,391 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=ff109ff5b69a09236d8e26cac06ad183, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:41,391 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=8f50653056db0fc97159c3a723710554, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:41,391 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1675961720347.ff109ff5b69a09236d8e26cac06ad183.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675961741391"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675961741391"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675961741391"}]},"ts":"1675961741391"} 2023-02-09 16:55:41,391 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=964f5813343e8a443a0a9846e8b60a1a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:41,391 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1675961720347.8f50653056db0fc97159c3a723710554.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675961741391"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675961741391"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675961741391"}]},"ts":"1675961741391"} 2023-02-09 16:55:41,392 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1675961720347.964f5813343e8a443a0a9846e8b60a1a.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675961741391"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675961741391"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675961741391"}]},"ts":"1675961741391"} 2023-02-09 16:55:41,393 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=92, ppid=90, state=RUNNABLE; CloseRegionProcedure ff109ff5b69a09236d8e26cac06ad183, server=jenkins-hbase4.apache.org,35511,1675961620699}] 2023-02-09 16:55:41,393 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; CloseRegionProcedure 8f50653056db0fc97159c3a723710554, server=jenkins-hbase4.apache.org,35511,1675961620699}] 2023-02-09 16:55:41,394 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=89, state=RUNNABLE; CloseRegionProcedure 964f5813343e8a443a0a9846e8b60a1a, server=jenkins-hbase4.apache.org,35511,1675961620699}] 2023-02-09 16:55:41,485 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:41,485 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:41,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-02-09 16:55:41,489 ERROR [ProcedureDispatcherTimeoutThread] procedure2.RemoteProcedureDispatcher$TimeoutExecutorThread(317): DelayQueue for RemoteProcedureDispatcher is not empty when timed waiting elapsed. If this is repeated consistently, it means no element is getting expired from the queue and it might freeze the system. Queue: [containedObject=jenkins-hbase4.apache.org,35511,1675961620699, timeout=1675961741544, delay=55, operations=[pid=94, ppid=89, state=RUNNABLE; CloseRegionProcedure 964f5813343e8a443a0a9846e8b60a1a, server=jenkins-hbase4.apache.org,35511,1675961620699, pid=93, ppid=91, state=RUNNABLE; CloseRegionProcedure 8f50653056db0fc97159c3a723710554, server=jenkins-hbase4.apache.org,35511,1675961620699, pid=92, ppid=90, state=RUNNABLE; CloseRegionProcedure ff109ff5b69a09236d8e26cac06ad183, server=jenkins-hbase4.apache.org,35511,1675961620699]] 2023-02-09 16:55:41,544 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 964f5813343e8a443a0a9846e8b60a1a 2023-02-09 16:55:41,544 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 964f5813343e8a443a0a9846e8b60a1a, disabling compactions & flushes 2023-02-09 16:55:41,544 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,,1675961720347.964f5813343e8a443a0a9846e8b60a1a. 2023-02-09 16:55:41,544 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,,1675961720347.964f5813343e8a443a0a9846e8b60a1a. 2023-02-09 16:55:41,545 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,,1675961720347.964f5813343e8a443a0a9846e8b60a1a. after waiting 1 ms 2023-02-09 16:55:41,545 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,,1675961720347.964f5813343e8a443a0a9846e8b60a1a. 2023-02-09 16:55:41,548 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-02-09 16:55:41,550 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,,1675961720347.964f5813343e8a443a0a9846e8b60a1a. 2023-02-09 16:55:41,550 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 964f5813343e8a443a0a9846e8b60a1a: Waiting for close lock at 1675961741544Running coprocessor pre-close hooks at 1675961741544Disabling compacts and flushes for region at 1675961741544Disabling writes for close at 1675961741545 (+1 ms)Writing region close event to WAL at 1675961741546 (+1 ms)Running coprocessor post-close hooks at 1675961741549 (+3 ms)Closed at 1675961741550 (+1 ms) 2023-02-09 16:55:41,551 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 964f5813343e8a443a0a9846e8b60a1a 2023-02-09 16:55:41,551 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 8f50653056db0fc97159c3a723710554 2023-02-09 16:55:41,551 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 8f50653056db0fc97159c3a723710554, disabling compactions & flushes 2023-02-09 16:55:41,551 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,2,1675961720347.8f50653056db0fc97159c3a723710554. 2023-02-09 16:55:41,551 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1675961720347.8f50653056db0fc97159c3a723710554. 2023-02-09 16:55:41,551 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,2,1675961720347.8f50653056db0fc97159c3a723710554. after waiting 0 ms 2023-02-09 16:55:41,551 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,2,1675961720347.8f50653056db0fc97159c3a723710554. 2023-02-09 16:55:41,551 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=964f5813343e8a443a0a9846e8b60a1a, regionState=CLOSED 2023-02-09 16:55:41,551 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1675961720347.964f5813343e8a443a0a9846e8b60a1a.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675961741551"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675961741551"}]},"ts":"1675961741551"} 2023-02-09 16:55:41,554 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=89 2023-02-09 16:55:41,554 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=89, state=SUCCESS; CloseRegionProcedure 964f5813343e8a443a0a9846e8b60a1a, server=jenkins-hbase4.apache.org,35511,1675961620699 in 159 msec 2023-02-09 16:55:41,555 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-02-09 16:55:41,555 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=89, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=964f5813343e8a443a0a9846e8b60a1a, UNASSIGN in 165 msec 2023-02-09 16:55:41,556 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,2,1675961720347.8f50653056db0fc97159c3a723710554. 2023-02-09 16:55:41,556 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 8f50653056db0fc97159c3a723710554: Waiting for close lock at 1675961741551Running coprocessor pre-close hooks at 1675961741551Disabling compacts and flushes for region at 1675961741551Disabling writes for close at 1675961741551Writing region close event to WAL at 1675961741552 (+1 ms)Running coprocessor post-close hooks at 1675961741555 (+3 ms)Closed at 1675961741556 (+1 ms) 2023-02-09 16:55:41,558 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 8f50653056db0fc97159c3a723710554 2023-02-09 16:55:41,558 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close ff109ff5b69a09236d8e26cac06ad183 2023-02-09 16:55:41,558 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing ff109ff5b69a09236d8e26cac06ad183, disabling compactions & flushes 2023-02-09 16:55:41,558 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,1,1675961720347.ff109ff5b69a09236d8e26cac06ad183. 2023-02-09 16:55:41,558 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1675961720347.ff109ff5b69a09236d8e26cac06ad183. 2023-02-09 16:55:41,558 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,1,1675961720347.ff109ff5b69a09236d8e26cac06ad183. after waiting 0 ms 2023-02-09 16:55:41,558 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,1,1675961720347.ff109ff5b69a09236d8e26cac06ad183. 2023-02-09 16:55:41,558 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=8f50653056db0fc97159c3a723710554, regionState=CLOSED 2023-02-09 16:55:41,558 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1675961720347.8f50653056db0fc97159c3a723710554.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675961741558"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675961741558"}]},"ts":"1675961741558"} 2023-02-09 16:55:41,561 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=91 2023-02-09 16:55:41,561 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=91, state=SUCCESS; CloseRegionProcedure 8f50653056db0fc97159c3a723710554, server=jenkins-hbase4.apache.org,35511,1675961620699 in 167 msec 2023-02-09 16:55:41,562 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=8f50653056db0fc97159c3a723710554, UNASSIGN in 172 msec 2023-02-09 16:55:41,569 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-02-09 16:55:41,570 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,1,1675961720347.ff109ff5b69a09236d8e26cac06ad183. 2023-02-09 16:55:41,570 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for ff109ff5b69a09236d8e26cac06ad183: Waiting for close lock at 1675961741558Running coprocessor pre-close hooks at 1675961741558Disabling compacts and flushes for region at 1675961741558Disabling writes for close at 1675961741558Writing region close event to WAL at 1675961741567 (+9 ms)Running coprocessor post-close hooks at 1675961741569 (+2 ms)Closed at 1675961741570 (+1 ms) 2023-02-09 16:55:41,571 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed ff109ff5b69a09236d8e26cac06ad183 2023-02-09 16:55:41,571 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=ff109ff5b69a09236d8e26cac06ad183, regionState=CLOSED 2023-02-09 16:55:41,571 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1675961720347.ff109ff5b69a09236d8e26cac06ad183.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675961741571"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675961741571"}]},"ts":"1675961741571"} 2023-02-09 16:55:41,573 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=90 2023-02-09 16:55:41,573 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; CloseRegionProcedure ff109ff5b69a09236d8e26cac06ad183, server=jenkins-hbase4.apache.org,35511,1675961620699 in 179 msec 2023-02-09 16:55:41,574 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=90, resume processing ppid=88 2023-02-09 16:55:41,574 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=90, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=ff109ff5b69a09236d8e26cac06ad183, UNASSIGN in 184 msec 2023-02-09 16:55:41,575 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675961741575"}]},"ts":"1675961741575"} 2023-02-09 16:55:41,575 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLED in hbase:meta 2023-02-09 16:55:41,577 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testCompactionWithHFileLink to state=DISABLED 2023-02-09 16:55:41,579 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=88, state=SUCCESS; DisableTableProcedure table=testCompactionWithHFileLink in 197 msec 2023-02-09 16:55:41,686 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:41,687 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:41,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-02-09 16:55:41,687 INFO [Listener at localhost/41619] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testCompactionWithHFileLink, procId: 88 completed 2023-02-09 16:55:41,688 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:41,688 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:41,697 INFO [Listener at localhost/41619] client.HBaseAdmin(2586): Taking restore-failsafe snapshot: hbase-failsafe-snaptb-1675961729200-1675961741697 2023-02-09 16:55:41,697 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:41,697 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:41,698 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=hbase-failsafe-snaptb-1675961729200-1675961741697 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-09 16:55:41,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1675961741698 (current time:1675961741698). 2023-02-09 16:55:41,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-09 16:55:41,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] zookeeper.ReadOnlyZKClient(139): Connect 0x6b502c2f to 127.0.0.1:53887 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 16:55:41,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4657e3d8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 16:55:41,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 16:55:41,706 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42814, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 16:55:41,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6b502c2f to 127.0.0.1:53887 2023-02-09 16:55:41,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 16:55:41,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-09 16:55:41,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] snapshot.SnapshotManager(659): Table is disabled, running snapshot entirely on master for { ss=hbase-failsafe-snaptb-1675961729200-1675961741697 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-09 16:55:41,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-09 16:55:41,710 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-09 16:55:41,710 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1675962341710 2023-02-09 16:55:41,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] snapshot.SnapshotManager(664): Started snapshot: { ss=hbase-failsafe-snaptb-1675961729200-1675961741697 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-09 16:55:41,710 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running DISABLED table snapshot hbase-failsafe-snaptb-1675961729200-1675961741697 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-02-09 16:55:41,711 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=hbase-failsafe-snaptb-1675961729200-1675961741697 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-02-09 16:55:41,711 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-09 16:55:41,811 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 16:55:41,811 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:41,811 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:41,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1675961729200-1675961741697 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-09 16:55:41,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1675961729200-1675961741697 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-09 16:55:41,812 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-09 16:55:42,012 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 16:55:42,012 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:42,012 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:42,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1675961729200-1675961741697 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-09 16:55:42,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1675961729200-1675961741697 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-09 16:55:42,013 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-09 16:55:42,116 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.DisabledTableSnapshotHandler(97): Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1675961729200-1675961741697 table=testCompactionWithHFileLink type=DISABLED ttl=0 } 2023-02-09 16:55:42,118 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-02-09 16:55:42,118 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-02-09 16:55:42,118 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-02-09 16:55:42,118 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-02-09 16:55:42,119 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-02-09 16:55:42,119 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-02-09 16:55:42,119 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-02-09 16:55:42,119 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-02-09 16:55:42,121 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1/5cd71a405530442898614d53b129a812_SeqId_29_, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1/7a0b18c051f247cfb601d2a92de447c7] hfiles 2023-02-09 16:55:42,121 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1/5cd71a405530442898614d53b129a812_SeqId_29_ 2023-02-09 16:55:42,121 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1/7a0b18c051f247cfb601d2a92de447c7 2023-02-09 16:55:42,121 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family1/668d307d54fb4bcebc1ca0368c8aec43_SeqId_29_, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family1/834e1a7a0e6b46249e2d94ba8724e509] hfiles 2023-02-09 16:55:42,121 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family1/668d307d54fb4bcebc1ca0368c8aec43_SeqId_29_ 2023-02-09 16:55:42,122 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family1/834e1a7a0e6b46249e2d94ba8724e509 2023-02-09 16:55:42,122 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family2/46bea0892b53463ba538e4f51b9a182a] hfiles 2023-02-09 16:55:42,122 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family2/46bea0892b53463ba538e4f51b9a182a 2023-02-09 16:55:42,122 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family2/6366fafe8b6644c6a63dc8935c367a9d] hfiles 2023-02-09 16:55:42,123 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family2/6366fafe8b6644c6a63dc8935c367a9d 2023-02-09 16:55:42,123 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family1/5aa712a0b006493fb690b864d8b0e7a3, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family1/5caccad1a6a44c3b8df01548a0a3476e_SeqId_29_] hfiles 2023-02-09 16:55:42,123 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family1/5aa712a0b006493fb690b864d8b0e7a3 2023-02-09 16:55:42,123 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family1/5caccad1a6a44c3b8df01548a0a3476e_SeqId_29_ 2023-02-09 16:55:42,124 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230209109fcd442a4e415abf3f337065e31e2f, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302099d3b323dbf824a769bc6e94663bf1fd0, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230209e455246dac744652bdb51ee7c98052e9] hfiles 2023-02-09 16:55:42,124 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/3): hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230209109fcd442a4e415abf3f337065e31e2f 2023-02-09 16:55:42,124 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/3): hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302099d3b323dbf824a769bc6e94663bf1fd0 2023-02-09 16:55:42,124 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/3): hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230209e455246dac744652bdb51ee7c98052e9 2023-02-09 16:55:42,124 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family2/45b89674170e487f98094d4ef060f8cd] hfiles 2023-02-09 16:55:42,124 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family2/45b89674170e487f98094d4ef060f8cd 2023-02-09 16:55:42,141 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023020982231d331f9c40bf8405b7ee2dca67cc, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230209bce6e987285a4c559249d798dce464ad, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230209cc4b108d971e4a1aa5e627d23ee25a0e, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230209db687be73cba47e494340b23a8a3a941_del, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230209fed187fa50e54366af3a1ed6b3afc793, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302094648339c3a1a4e5bb11592c5c9702e25, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302094930207ceb9141bfa31ba817e12f3a1c, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023020955420b67ebc8477bac67fc9516cb0de2_del, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230209c3380e409fd7453687655309ff29c642, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230209cb92ed45f4cf400d97d85d402d1107e1, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230209112d4355b5014688bf9e143f89d91c07, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302092e3daad91766434db0eefe9d294d67e9_del, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230209346859ce7e9a45b1857ee7f3a1bcc69c, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023020979d05d633b5b49d5815baf8c663d8a01, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230209904d495414744a3ebf16ef6e61e5424e] hfiles 2023-02-09 16:55:42,141 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/15): hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023020982231d331f9c40bf8405b7ee2dca67cc 2023-02-09 16:55:42,141 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/15): hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230209bce6e987285a4c559249d798dce464ad 2023-02-09 16:55:42,141 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/15): hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230209cc4b108d971e4a1aa5e627d23ee25a0e 2023-02-09 16:55:42,141 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (4/15): hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230209db687be73cba47e494340b23a8a3a941_del 2023-02-09 16:55:42,141 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (5/15): hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230209fed187fa50e54366af3a1ed6b3afc793 2023-02-09 16:55:42,141 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (6/15): hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302094648339c3a1a4e5bb11592c5c9702e25 2023-02-09 16:55:42,141 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (7/15): hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302094930207ceb9141bfa31ba817e12f3a1c 2023-02-09 16:55:42,141 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (8/15): hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023020955420b67ebc8477bac67fc9516cb0de2_del 2023-02-09 16:55:42,141 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (9/15): hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230209c3380e409fd7453687655309ff29c642 2023-02-09 16:55:42,141 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (10/15): hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230209cb92ed45f4cf400d97d85d402d1107e1 2023-02-09 16:55:42,141 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (11/15): hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230209112d4355b5014688bf9e143f89d91c07 2023-02-09 16:55:42,141 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (12/15): hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302092e3daad91766434db0eefe9d294d67e9_del 2023-02-09 16:55:42,141 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (13/15): hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230209346859ce7e9a45b1857ee7f3a1bcc69c 2023-02-09 16:55:42,141 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (14/15): hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023020979d05d633b5b49d5815baf8c663d8a01 2023-02-09 16:55:42,141 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (15/15): hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230209904d495414744a3ebf16ef6e61e5424e 2023-02-09 16:55:42,238 DEBUG [regionserver/jenkins-hbase4:0.Chore.2] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-02-09 16:55:42,313 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 16:55:42,314 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:42,314 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:42,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1675961729200-1675961741697 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-09 16:55:42,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1675961729200-1675961741697 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-09 16:55:42,314 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-09 16:55:42,555 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.DisabledTableSnapshotHandler(120): Marking snapshot{ ss=hbase-failsafe-snaptb-1675961729200-1675961741697 table=testCompactionWithHFileLink type=DISABLED ttl=0 } as finished. 2023-02-09 16:55:42,556 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for hbase-failsafe-snaptb-1675961729200-1675961741697 2023-02-09 16:55:42,556 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1675961729200-1675961741697 2023-02-09 16:55:42,584 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1675961729200-1675961741697 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.hbase-snapshot/hbase-failsafe-snaptb-1675961729200-1675961741697 2023-02-09 16:55:42,815 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 16:55:42,815 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:42,815 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:42,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1675961729200-1675961741697 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-09 16:55:42,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1675961729200-1675961741697 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-09 16:55:42,816 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-09 16:55:43,397 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot hbase-failsafe-snaptb-1675961729200-1675961741697 of table testCompactionWithHFileLink completed 2023-02-09 16:55:43,397 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1675961729200-1675961741697 2023-02-09 16:55:43,398 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1675961729200-1675961741697 2023-02-09 16:55:43,398 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running DISABLED table snapshot hbase-failsafe-snaptb-1675961729200-1675961741697 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1675961741710Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1675961729200-1675961741697 table=testCompactionWithHFileLink type=DISABLED ttl=0 } at 1675961742116 (+406 ms)Consolidate snapshot: hbase-failsafe-snaptb-1675961729200-1675961741697 at 1675961742556 (+440 ms)Loading Region manifests for hbase-failsafe-snaptb-1675961729200-1675961741697 at 1675961742556Writing data manifest for hbase-failsafe-snaptb-1675961729200-1675961741697 at 1675961742559 (+3 ms)Verifying snapshot: hbase-failsafe-snaptb-1675961729200-1675961741697 at 1675961742568 (+9 ms)Snapshot hbase-failsafe-snaptb-1675961729200-1675961741697 of table testCompactionWithHFileLink completed at 1675961743397 (+829 ms) 2023-02-09 16:55:43,399 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-09 16:55:43,400 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 1.6900 sec 2023-02-09 16:55:43,816 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 16:55:43,816 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:43,816 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:43,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1675961729200-1675961741697 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-09 16:55:43,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] snapshot.SnapshotManager(401): Snapshot '{ ss=hbase-failsafe-snaptb-1675961729200-1675961741697 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-09 16:55:43,818 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:43,818 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:43,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE:RESTORE_SNAPSHOT_PRE_OPERATION; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1675961729200" table: "testCompactionWithHFileLink" creation_time: 1675961729210 type: FLUSH version: 2 ttl: 0 ) 2023-02-09 16:55:43,855 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] snapshot.SnapshotManager(880): Restore snapshot=snaptb-1675961729200 as table=testCompactionWithHFileLink 2023-02-09 16:55:43,858 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:43,858 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:43,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-02-09 16:55:43,959 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:43,959 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:43,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-02-09 16:55:44,160 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:44,160 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:44,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-02-09 16:55:44,265 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-02-09 16:55:44,266 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-02-09 16:55:44,266 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-02-09 16:55:44,267 INFO [PEWorker-5] procedure.RestoreSnapshotProcedure(374): Starting restore snapshot={ ss=snaptb-1675961729200 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-09 16:55:44,272 INFO [PEWorker-5] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "snaptb-1675961729200" table: "testCompactionWithHFileLink" creation_time: 1675961729210 type: FLUSH version: 2 ttl: 0 2023-02-09 16:55:44,273 DEBUG [PEWorker-5] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink 2023-02-09 16:55:44,278 DEBUG [PEWorker-5] snapshot.RestoreSnapshotHelper(797): found 3 regions for table=testCompactionWithHFileLink 2023-02-09 16:55:44,281 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230209109fcd442a4e415abf3f337065e31e2f to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230209109fcd442a4e415abf3f337065e31e2f 2023-02-09 16:55:44,283 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302099d3b323dbf824a769bc6e94663bf1fd0 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302099d3b323dbf824a769bc6e94663bf1fd0 2023-02-09 16:55:44,284 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230209e455246dac744652bdb51ee7c98052e9 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230209e455246dac744652bdb51ee7c98052e9 2023-02-09 16:55:44,284 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b2023020920cc890cd42446f29aa42a9853cbea21 of snapshot=snaptb-1675961729200 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-09 16:55:44,288 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b2023020929b05f21007847e19c056e5dd4865367 of snapshot=snaptb-1675961729200 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-09 16:55:44,291 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b202302095021cf77926d4cc381f0f752f0dacf42 of snapshot=snaptb-1675961729200 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-09 16:55:44,294 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20230209a1c3b9e7c7924e958bf64ca5d6182f60 of snapshot=snaptb-1675961729200 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-09 16:55:44,297 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c2023020926654af107cf4162ad4745bfa2f1ca26 of snapshot=snaptb-1675961729200 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-09 16:55:44,300 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c202302096bcc7efd6cc84d2fbda5375b5938e8be of snapshot=snaptb-1675961729200 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-09 16:55:44,304 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c202302099bcabcbba46349fb98ce3d3b3b7fe317 of snapshot=snaptb-1675961729200 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-09 16:55:44,307 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20230209ecf6c4e2f15a431dba58fdc14222af40 of snapshot=snaptb-1675961729200 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-09 16:55:44,311 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e202302090b627555e2784172917cd94efc2d6532 of snapshot=snaptb-1675961729200 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-09 16:55:44,314 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e2023020981776dbf549d496f905da8431c141ba1 of snapshot=snaptb-1675961729200 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-09 16:55:44,317 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20230209c06eb6440a0b47869da46e27ce12e759 of snapshot=snaptb-1675961729200 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-09 16:55:44,321 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20230209cdaa8e47ff974e13abc12d6b32848b7f of snapshot=snaptb-1675961729200 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-09 16:55:44,326 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302092e3daad91766434db0eefe9d294d67e9_del to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302092e3daad91766434db0eefe9d294d67e9_del 2023-02-09 16:55:44,328 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023020955420b67ebc8477bac67fc9516cb0de2_del to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023020955420b67ebc8477bac67fc9516cb0de2_del 2023-02-09 16:55:44,329 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230209db687be73cba47e494340b23a8a3a941_del to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230209db687be73cba47e494340b23a8a3a941_del 2023-02-09 16:55:44,329 INFO [PEWorker-5] snapshot.RestoreSnapshotHelper(223): region to restore: 8f50653056db0fc97159c3a723710554 2023-02-09 16:55:44,330 INFO [PEWorker-5] snapshot.RestoreSnapshotHelper(223): region to restore: 964f5813343e8a443a0a9846e8b60a1a 2023-02-09 16:55:44,330 INFO [PEWorker-5] snapshot.RestoreSnapshotHelper(223): region to restore: ff109ff5b69a09236d8e26cac06ad183 2023-02-09 16:55:44,334 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family1/5caccad1a6a44c3b8df01548a0a3476e_SeqId_29_ to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family1/5caccad1a6a44c3b8df01548a0a3476e_SeqId_29_ 2023-02-09 16:55:44,334 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1/7a0b18c051f247cfb601d2a92de447c7 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1/7a0b18c051f247cfb601d2a92de447c7 2023-02-09 16:55:44,334 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family1/668d307d54fb4bcebc1ca0368c8aec43_SeqId_29_ to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family1/668d307d54fb4bcebc1ca0368c8aec43_SeqId_29_ 2023-02-09 16:55:44,335 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family1/5aa712a0b006493fb690b864d8b0e7a3 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family1/5aa712a0b006493fb690b864d8b0e7a3 2023-02-09 16:55:44,335 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink cdc0da56512c47e9905d91d398ff9cee of snapshot=snaptb-1675961729200 to region=964f5813343e8a443a0a9846e8b60a1a table=testCompactionWithHFileLink 2023-02-09 16:55:44,335 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1/5cd71a405530442898614d53b129a812_SeqId_29_ to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1/5cd71a405530442898614d53b129a812_SeqId_29_ 2023-02-09 16:55:44,336 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family1/834e1a7a0e6b46249e2d94ba8724e509 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family1/834e1a7a0e6b46249e2d94ba8724e509 2023-02-09 16:55:44,336 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 9960ca25ee884e899d44d73e77321d91 of snapshot=snaptb-1675961729200 to region=8f50653056db0fc97159c3a723710554 table=testCompactionWithHFileLink 2023-02-09 16:55:44,336 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 23928677550e4b8d89458a32e18e9063 of snapshot=snaptb-1675961729200 to region=ff109ff5b69a09236d8e26cac06ad183 table=testCompactionWithHFileLink 2023-02-09 16:55:44,339 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 2040a0c0d6b74a2a84f36b91f50ba877 of snapshot=snaptb-1675961729200 to region=964f5813343e8a443a0a9846e8b60a1a table=testCompactionWithHFileLink 2023-02-09 16:55:44,339 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 803335f8c9474fcf8a2ea08851a991db of snapshot=snaptb-1675961729200 to region=ff109ff5b69a09236d8e26cac06ad183 table=testCompactionWithHFileLink 2023-02-09 16:55:44,339 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink bbd66b2a75854d769f68ec967526f8e4 of snapshot=snaptb-1675961729200 to region=8f50653056db0fc97159c3a723710554 table=testCompactionWithHFileLink 2023-02-09 16:55:44,343 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 4b47145a05c04482887ccb260167014f of snapshot=snaptb-1675961729200 to region=ff109ff5b69a09236d8e26cac06ad183 table=testCompactionWithHFileLink 2023-02-09 16:55:44,343 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 91b9b6b408b346eebf03b112c14765f1 of snapshot=snaptb-1675961729200 to region=964f5813343e8a443a0a9846e8b60a1a table=testCompactionWithHFileLink 2023-02-09 16:55:44,344 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 95fe8fee4073477c8d575821319f6012 of snapshot=snaptb-1675961729200 to region=8f50653056db0fc97159c3a723710554 table=testCompactionWithHFileLink 2023-02-09 16:55:44,348 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 2f43f0ba911c4f1daa2bfa44de772d28 of snapshot=snaptb-1675961729200 to region=964f5813343e8a443a0a9846e8b60a1a table=testCompactionWithHFileLink 2023-02-09 16:55:44,348 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c9eca6421ae74a5d83702f06efa00d4f of snapshot=snaptb-1675961729200 to region=ff109ff5b69a09236d8e26cac06ad183 table=testCompactionWithHFileLink 2023-02-09 16:55:44,349 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink b5696cb1277d4b3f9d2aaf063efb7dbd of snapshot=snaptb-1675961729200 to region=8f50653056db0fc97159c3a723710554 table=testCompactionWithHFileLink 2023-02-09 16:55:44,360 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family2/45b89674170e487f98094d4ef060f8cd to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family2/45b89674170e487f98094d4ef060f8cd 2023-02-09 16:55:44,360 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 6a91dabe164b468b8eb198799372a729 of snapshot=snaptb-1675961729200 to region=964f5813343e8a443a0a9846e8b60a1a table=testCompactionWithHFileLink 2023-02-09 16:55:44,360 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family2/46bea0892b53463ba538e4f51b9a182a to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family2/46bea0892b53463ba538e4f51b9a182a 2023-02-09 16:55:44,360 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 83269f5b6253457b801063cde566d9a5 of snapshot=snaptb-1675961729200 to region=8f50653056db0fc97159c3a723710554 table=testCompactionWithHFileLink 2023-02-09 16:55:44,360 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family2/6366fafe8b6644c6a63dc8935c367a9d to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family2/6366fafe8b6644c6a63dc8935c367a9d 2023-02-09 16:55:44,360 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink e1834c7e198d4a5492a909f9090dba11 of snapshot=snaptb-1675961729200 to region=ff109ff5b69a09236d8e26cac06ad183 table=testCompactionWithHFileLink 2023-02-09 16:55:44,367 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 61d7c5d467734196aaf47bb8a75ee866 of snapshot=snaptb-1675961729200 to region=964f5813343e8a443a0a9846e8b60a1a table=testCompactionWithHFileLink 2023-02-09 16:55:44,367 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 253a38900d1948339df6cb97b5c85255 of snapshot=snaptb-1675961729200 to region=8f50653056db0fc97159c3a723710554 table=testCompactionWithHFileLink 2023-02-09 16:55:44,367 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink cf952d5d378641a494409f4684fd499b of snapshot=snaptb-1675961729200 to region=ff109ff5b69a09236d8e26cac06ad183 table=testCompactionWithHFileLink 2023-02-09 16:55:44,371 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 41872818fa124596bdceeb9e4d43509d of snapshot=snaptb-1675961729200 to region=964f5813343e8a443a0a9846e8b60a1a table=testCompactionWithHFileLink 2023-02-09 16:55:44,371 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 2b4aaa427870487695f27db022840756 of snapshot=snaptb-1675961729200 to region=8f50653056db0fc97159c3a723710554 table=testCompactionWithHFileLink 2023-02-09 16:55:44,371 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 1339a57e456946d083bc26ef990b55e2 of snapshot=snaptb-1675961729200 to region=ff109ff5b69a09236d8e26cac06ad183 table=testCompactionWithHFileLink 2023-02-09 16:55:44,374 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 6c223c6d2b8747279825b472ebbe3b88 of snapshot=snaptb-1675961729200 to region=964f5813343e8a443a0a9846e8b60a1a table=testCompactionWithHFileLink 2023-02-09 16:55:44,374 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 1c3a8a6e6ea44571b8fda362269e1731 of snapshot=snaptb-1675961729200 to region=8f50653056db0fc97159c3a723710554 table=testCompactionWithHFileLink 2023-02-09 16:55:44,375 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 3a4e6fb98efd4681973e25dee0f08c97 of snapshot=snaptb-1675961729200 to region=ff109ff5b69a09236d8e26cac06ad183 table=testCompactionWithHFileLink 2023-02-09 16:55:44,379 INFO [PEWorker-5] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "snaptb-1675961729200" table: "testCompactionWithHFileLink" creation_time: 1675961729210 type: FLUSH version: 2 ttl: 0 2023-02-09 16:55:44,380 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,2,1675961720347.8f50653056db0fc97159c3a723710554.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675961744380"}]},"ts":"9223372036854775807"} 2023-02-09 16:55:44,380 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,,1675961720347.964f5813343e8a443a0a9846e8b60a1a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675961744380"}]},"ts":"9223372036854775807"} 2023-02-09 16:55:44,380 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,1,1675961720347.ff109ff5b69a09236d8e26cac06ad183.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675961744380"}]},"ts":"9223372036854775807"} 2023-02-09 16:55:44,382 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 3 regions from META 2023-02-09 16:55:44,382 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 8f50653056db0fc97159c3a723710554, NAME => 'testCompactionWithHFileLink,2,1675961720347.8f50653056db0fc97159c3a723710554.', STARTKEY => '2', ENDKEY => ''}, {ENCODED => 964f5813343e8a443a0a9846e8b60a1a, NAME => 'testCompactionWithHFileLink,,1675961720347.964f5813343e8a443a0a9846e8b60a1a.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => ff109ff5b69a09236d8e26cac06ad183, NAME => 'testCompactionWithHFileLink,1,1675961720347.ff109ff5b69a09236d8e26cac06ad183.', STARTKEY => '1', ENDKEY => '2'}] 2023-02-09 16:55:44,382 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1675961720347.8f50653056db0fc97159c3a723710554.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675961744381"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675961744381"}]},"ts":"1675961744381"} 2023-02-09 16:55:44,382 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1675961720347.964f5813343e8a443a0a9846e8b60a1a.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675961744381"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675961744381"}]},"ts":"1675961744381"} 2023-02-09 16:55:44,382 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1675961720347.ff109ff5b69a09236d8e26cac06ad183.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675961744381"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675961744381"}]},"ts":"1675961744381"} 2023-02-09 16:55:44,384 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-02-09 16:55:44,384 INFO [PEWorker-5] hbase.MetaTableAccessor(1810): Overwritten 3 regions to Meta 2023-02-09 16:55:44,384 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1811): Overwritten regions: [{ENCODED => 8f50653056db0fc97159c3a723710554, NAME => 'testCompactionWithHFileLink,2,1675961720347.8f50653056db0fc97159c3a723710554.', STARTKEY => '2', ENDKEY => ''}, {ENCODED => 964f5813343e8a443a0a9846e8b60a1a, NAME => 'testCompactionWithHFileLink,,1675961720347.964f5813343e8a443a0a9846e8b60a1a.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => ff109ff5b69a09236d8e26cac06ad183, NAME => 'testCompactionWithHFileLink,1,1675961720347.ff109ff5b69a09236d8e26cac06ad183.', STARTKEY => '1', ENDKEY => '2'}] 2023-02-09 16:55:44,384 INFO [PEWorker-5] procedure.RestoreSnapshotProcedure(447): Restore snapshot={ ss=snaptb-1675961729200 table=testCompactionWithHFileLink type=FLUSH ttl=0 } on table=testCompactionWithHFileLink completed! 2023-02-09 16:55:44,386 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1675961729200" table: "testCompactionWithHFileLink" creation_time: 1675961729210 type: FLUSH version: 2 ttl: 0 ) in 538 msec 2023-02-09 16:55:44,461 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:44,461 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:44,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-02-09 16:55:44,462 INFO [Listener at localhost/41619] client.HBaseAdmin$TableFuture(3541): Operation: MODIFY, Table Name: default:testCompactionWithHFileLink, procId: 96 completed 2023-02-09 16:55:44,462 INFO [Listener at localhost/41619] client.HBaseAdmin(2618): Deleting restore-failsafe snapshot: hbase-failsafe-snaptb-1675961729200-1675961741697 2023-02-09 16:55:44,463 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:44,463 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:44,467 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "hbase-failsafe-snaptb-1675961729200-1675961741697" 2023-02-09 16:55:44,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] snapshot.SnapshotManager(333): Deleting snapshot: hbase-failsafe-snaptb-1675961729200-1675961741697 2023-02-09 16:55:44,471 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:44,472 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:44,472 INFO [Listener at localhost/41619] client.HBaseAdmin$14(830): Started enable of testCompactionWithHFileLink 2023-02-09 16:55:44,477 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.HMaster$10(2372): Client=jenkins//172.31.14.131 enable testCompactionWithHFileLink 2023-02-09 16:55:44,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE:ENABLE_TABLE_PREPARE; EnableTableProcedure table=testCompactionWithHFileLink 2023-02-09 16:55:44,486 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:44,486 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:44,487 INFO [PEWorker-2] procedure.EnableTableProcedure(296): Attempting to enable the table testCompactionWithHFileLink 2023-02-09 16:55:44,487 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675961744487"}]},"ts":"1675961744487"} 2023-02-09 16:55:44,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-02-09 16:55:44,488 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-02-09 16:55:44,490 DEBUG [PEWorker-2] procedure.EnableTableProcedure(107): No change in number of region replicas (configuredReplicaCount=1); assigning. 2023-02-09 16:55:44,490 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=964f5813343e8a443a0a9846e8b60a1a, ASSIGN}, {pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=ff109ff5b69a09236d8e26cac06ad183, ASSIGN}, {pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=8f50653056db0fc97159c3a723710554, ASSIGN}] 2023-02-09 16:55:44,492 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=8f50653056db0fc97159c3a723710554, ASSIGN 2023-02-09 16:55:44,492 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=964f5813343e8a443a0a9846e8b60a1a, ASSIGN 2023-02-09 16:55:44,492 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=ff109ff5b69a09236d8e26cac06ad183, ASSIGN 2023-02-09 16:55:44,493 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=8f50653056db0fc97159c3a723710554, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-02-09 16:55:44,493 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=964f5813343e8a443a0a9846e8b60a1a, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-02-09 16:55:44,493 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=ff109ff5b69a09236d8e26cac06ad183, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-02-09 16:55:44,588 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:44,588 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:44,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-02-09 16:55:44,645 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=ff109ff5b69a09236d8e26cac06ad183, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:44,645 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=964f5813343e8a443a0a9846e8b60a1a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:44,645 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=8f50653056db0fc97159c3a723710554, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:44,645 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1675961720347.ff109ff5b69a09236d8e26cac06ad183.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675961744645"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675961744645"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675961744645"}]},"ts":"1675961744645"} 2023-02-09 16:55:44,645 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1675961720347.8f50653056db0fc97159c3a723710554.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675961744645"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675961744645"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675961744645"}]},"ts":"1675961744645"} 2023-02-09 16:55:44,645 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1675961720347.964f5813343e8a443a0a9846e8b60a1a.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675961744645"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675961744645"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675961744645"}]},"ts":"1675961744645"} 2023-02-09 16:55:44,647 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=101, ppid=99, state=RUNNABLE; OpenRegionProcedure ff109ff5b69a09236d8e26cac06ad183, server=jenkins-hbase4.apache.org,35511,1675961620699}] 2023-02-09 16:55:44,647 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; OpenRegionProcedure 8f50653056db0fc97159c3a723710554, server=jenkins-hbase4.apache.org,35511,1675961620699}] 2023-02-09 16:55:44,648 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=98, state=RUNNABLE; OpenRegionProcedure 964f5813343e8a443a0a9846e8b60a1a, server=jenkins-hbase4.apache.org,35511,1675961620699}] 2023-02-09 16:55:44,789 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:44,789 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:44,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-02-09 16:55:44,801 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,1,1675961720347.ff109ff5b69a09236d8e26cac06ad183. 2023-02-09 16:55:44,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ff109ff5b69a09236d8e26cac06ad183, NAME => 'testCompactionWithHFileLink,1,1675961720347.ff109ff5b69a09236d8e26cac06ad183.', STARTKEY => '1', ENDKEY => '2'} 2023-02-09 16:55:44,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink ff109ff5b69a09236d8e26cac06ad183 2023-02-09 16:55:44,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,1,1675961720347.ff109ff5b69a09236d8e26cac06ad183.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 16:55:44,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for ff109ff5b69a09236d8e26cac06ad183 2023-02-09 16:55:44,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for ff109ff5b69a09236d8e26cac06ad183 2023-02-09 16:55:44,802 INFO [StoreOpener-ff109ff5b69a09236d8e26cac06ad183-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region ff109ff5b69a09236d8e26cac06ad183 2023-02-09 16:55:44,803 DEBUG [StoreOpener-ff109ff5b69a09236d8e26cac06ad183-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family1 2023-02-09 16:55:44,803 DEBUG [StoreOpener-ff109ff5b69a09236d8e26cac06ad183-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family1 2023-02-09 16:55:44,803 INFO [StoreOpener-ff109ff5b69a09236d8e26cac06ad183-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ff109ff5b69a09236d8e26cac06ad183 columnFamilyName family1 2023-02-09 16:55:44,821 DEBUG [StoreOpener-ff109ff5b69a09236d8e26cac06ad183-1] regionserver.HStore(539): loaded hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family1/testCompactionWithHFileLink=ff109ff5b69a09236d8e26cac06ad183-23928677550e4b8d89458a32e18e9063 2023-02-09 16:55:44,827 DEBUG [StoreOpener-ff109ff5b69a09236d8e26cac06ad183-1] regionserver.HStore(539): loaded hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family1/testCompactionWithHFileLink=ff109ff5b69a09236d8e26cac06ad183-4b47145a05c04482887ccb260167014f 2023-02-09 16:55:44,832 DEBUG [StoreOpener-ff109ff5b69a09236d8e26cac06ad183-1] regionserver.HStore(539): loaded hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family1/testCompactionWithHFileLink=ff109ff5b69a09236d8e26cac06ad183-803335f8c9474fcf8a2ea08851a991db 2023-02-09 16:55:44,838 DEBUG [StoreOpener-ff109ff5b69a09236d8e26cac06ad183-1] regionserver.HStore(539): loaded hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family1/testCompactionWithHFileLink=ff109ff5b69a09236d8e26cac06ad183-c9eca6421ae74a5d83702f06efa00d4f 2023-02-09 16:55:44,838 INFO [StoreOpener-ff109ff5b69a09236d8e26cac06ad183-1] regionserver.HStore(310): Store=ff109ff5b69a09236d8e26cac06ad183/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 16:55:44,838 INFO [StoreOpener-ff109ff5b69a09236d8e26cac06ad183-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region ff109ff5b69a09236d8e26cac06ad183 2023-02-09 16:55:44,839 DEBUG [StoreOpener-ff109ff5b69a09236d8e26cac06ad183-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family2 2023-02-09 16:55:44,839 DEBUG [StoreOpener-ff109ff5b69a09236d8e26cac06ad183-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family2 2023-02-09 16:55:44,839 INFO [StoreOpener-ff109ff5b69a09236d8e26cac06ad183-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ff109ff5b69a09236d8e26cac06ad183 columnFamilyName family2 2023-02-09 16:55:44,847 DEBUG [StoreOpener-ff109ff5b69a09236d8e26cac06ad183-1] regionserver.HStore(539): loaded hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family2/testCompactionWithHFileLink=ff109ff5b69a09236d8e26cac06ad183-1339a57e456946d083bc26ef990b55e2 2023-02-09 16:55:44,854 DEBUG [StoreOpener-ff109ff5b69a09236d8e26cac06ad183-1] regionserver.HStore(539): loaded hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family2/testCompactionWithHFileLink=ff109ff5b69a09236d8e26cac06ad183-3a4e6fb98efd4681973e25dee0f08c97 2023-02-09 16:55:44,860 DEBUG [StoreOpener-ff109ff5b69a09236d8e26cac06ad183-1] regionserver.HStore(539): loaded hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family2/testCompactionWithHFileLink=ff109ff5b69a09236d8e26cac06ad183-cf952d5d378641a494409f4684fd499b 2023-02-09 16:55:44,866 DEBUG [StoreOpener-ff109ff5b69a09236d8e26cac06ad183-1] regionserver.HStore(539): loaded hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family2/testCompactionWithHFileLink=ff109ff5b69a09236d8e26cac06ad183-e1834c7e198d4a5492a909f9090dba11 2023-02-09 16:55:44,866 INFO [StoreOpener-ff109ff5b69a09236d8e26cac06ad183-1] regionserver.HStore(310): Store=ff109ff5b69a09236d8e26cac06ad183/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 16:55:44,867 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183 2023-02-09 16:55:44,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183 2023-02-09 16:55:44,871 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 16:55:44,872 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for ff109ff5b69a09236d8e26cac06ad183 2023-02-09 16:55:44,873 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened ff109ff5b69a09236d8e26cac06ad183; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66217791, jitterRate=-0.013278022408485413}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 16:55:44,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for ff109ff5b69a09236d8e26cac06ad183: Running coprocessor pre-open hook at 1675961744801Writing region info on filesystem at 1675961744801Initializing all the Stores at 1675961744802 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675961744802Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675961744802Cleaning up temporary data from old regions at 1675961744869 (+67 ms)Cleaning up detritus from prior splits at 1675961744870 (+1 ms)Running coprocessor post-open hooks at 1675961744873 (+3 ms)Region opened successfully at 1675961744873 2023-02-09 16:55:44,874 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,1,1675961720347.ff109ff5b69a09236d8e26cac06ad183., pid=101, masterSystemTime=1675961744798 2023-02-09 16:55:44,874 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 16:55:44,875 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-02-09 16:55:44,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-02-09 16:55:44,875 DEBUG [RS:0;jenkins-hbase4:35511-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-02-09 16:55:44,878 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-02-09 16:55:44,877 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=ff109ff5b69a09236d8e26cac06ad183, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:44,884 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HStore(1912): ff109ff5b69a09236d8e26cac06ad183/family1 is initiating minor compaction (all files) 2023-02-09 16:55:44,877 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,1,1675961720347.ff109ff5b69a09236d8e26cac06ad183. 2023-02-09 16:55:44,884 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,1,1675961720347.ff109ff5b69a09236d8e26cac06ad183. 2023-02-09 16:55:44,884 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of ff109ff5b69a09236d8e26cac06ad183/family1 in testCompactionWithHFileLink,1,1675961720347.ff109ff5b69a09236d8e26cac06ad183. 2023-02-09 16:55:44,884 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,,1675961720347.964f5813343e8a443a0a9846e8b60a1a. 2023-02-09 16:55:44,884 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1675961720347.ff109ff5b69a09236d8e26cac06ad183.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675961744877"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675961744877"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675961744877"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675961744877"}]},"ts":"1675961744877"} 2023-02-09 16:55:44,884 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family1/testCompactionWithHFileLink=ff109ff5b69a09236d8e26cac06ad183-23928677550e4b8d89458a32e18e9063, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family1/testCompactionWithHFileLink=ff109ff5b69a09236d8e26cac06ad183-803335f8c9474fcf8a2ea08851a991db, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family1/testCompactionWithHFileLink=ff109ff5b69a09236d8e26cac06ad183-4b47145a05c04482887ccb260167014f, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family1/testCompactionWithHFileLink=ff109ff5b69a09236d8e26cac06ad183-c9eca6421ae74a5d83702f06efa00d4f] into tmpdir=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/.tmp, totalSize=21.6 K 2023-02-09 16:55:44,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 964f5813343e8a443a0a9846e8b60a1a, NAME => 'testCompactionWithHFileLink,,1675961720347.964f5813343e8a443a0a9846e8b60a1a.', STARTKEY => '', ENDKEY => '1'} 2023-02-09 16:55:44,885 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 964f5813343e8a443a0a9846e8b60a1a 2023-02-09 16:55:44,885 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,,1675961720347.964f5813343e8a443a0a9846e8b60a1a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 16:55:44,885 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 964f5813343e8a443a0a9846e8b60a1a 2023-02-09 16:55:44,885 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 964f5813343e8a443a0a9846e8b60a1a 2023-02-09 16:55:44,886 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=ff109ff5b69a09236d8e26cac06ad183-23928677550e4b8d89458a32e18e9063, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675961722464 2023-02-09 16:55:44,887 INFO [StoreOpener-964f5813343e8a443a0a9846e8b60a1a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 964f5813343e8a443a0a9846e8b60a1a 2023-02-09 16:55:44,887 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=99 2023-02-09 16:55:44,887 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; OpenRegionProcedure ff109ff5b69a09236d8e26cac06ad183, server=jenkins-hbase4.apache.org,35511,1675961620699 in 239 msec 2023-02-09 16:55:44,888 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=ff109ff5b69a09236d8e26cac06ad183-803335f8c9474fcf8a2ea08851a991db, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675961723846 2023-02-09 16:55:44,888 DEBUG [RS:0;jenkins-hbase4:35511-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-02-09 16:55:44,888 DEBUG [RS:0;jenkins-hbase4:35511-longCompactions-0] regionserver.HStore(1912): ff109ff5b69a09236d8e26cac06ad183/family2 is initiating minor compaction (all files) 2023-02-09 16:55:44,888 INFO [RS:0;jenkins-hbase4:35511-longCompactions-0] regionserver.HRegion(2258): Starting compaction of ff109ff5b69a09236d8e26cac06ad183/family2 in testCompactionWithHFileLink,1,1675961720347.ff109ff5b69a09236d8e26cac06ad183. 2023-02-09 16:55:44,888 INFO [RS:0;jenkins-hbase4:35511-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family2/testCompactionWithHFileLink=ff109ff5b69a09236d8e26cac06ad183-e1834c7e198d4a5492a909f9090dba11, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family2/testCompactionWithHFileLink=ff109ff5b69a09236d8e26cac06ad183-cf952d5d378641a494409f4684fd499b, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family2/testCompactionWithHFileLink=ff109ff5b69a09236d8e26cac06ad183-1339a57e456946d083bc26ef990b55e2, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family2/testCompactionWithHFileLink=ff109ff5b69a09236d8e26cac06ad183-3a4e6fb98efd4681973e25dee0f08c97] into tmpdir=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/.tmp, totalSize=20.4 K 2023-02-09 16:55:44,888 DEBUG [StoreOpener-964f5813343e8a443a0a9846e8b60a1a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family1 2023-02-09 16:55:44,888 DEBUG [StoreOpener-964f5813343e8a443a0a9846e8b60a1a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family1 2023-02-09 16:55:44,889 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=99, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=ff109ff5b69a09236d8e26cac06ad183, ASSIGN in 398 msec 2023-02-09 16:55:44,889 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=ff109ff5b69a09236d8e26cac06ad183-4b47145a05c04482887ccb260167014f, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675961725624 2023-02-09 16:55:44,889 DEBUG [RS:0;jenkins-hbase4:35511-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=ff109ff5b69a09236d8e26cac06ad183-e1834c7e198d4a5492a909f9090dba11, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675961722464 2023-02-09 16:55:44,889 INFO [StoreOpener-964f5813343e8a443a0a9846e8b60a1a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 964f5813343e8a443a0a9846e8b60a1a columnFamilyName family1 2023-02-09 16:55:44,889 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=ff109ff5b69a09236d8e26cac06ad183-c9eca6421ae74a5d83702f06efa00d4f, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675961727415 2023-02-09 16:55:44,889 DEBUG [RS:0;jenkins-hbase4:35511-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=ff109ff5b69a09236d8e26cac06ad183-cf952d5d378641a494409f4684fd499b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675961723846 2023-02-09 16:55:44,891 DEBUG [RS:0;jenkins-hbase4:35511-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=ff109ff5b69a09236d8e26cac06ad183-1339a57e456946d083bc26ef990b55e2, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675961725624 2023-02-09 16:55:44,891 DEBUG [RS:0;jenkins-hbase4:35511-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=ff109ff5b69a09236d8e26cac06ad183-3a4e6fb98efd4681973e25dee0f08c97, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675961727415 2023-02-09 16:55:44,904 DEBUG [StoreOpener-964f5813343e8a443a0a9846e8b60a1a-1] regionserver.HStore(539): loaded hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family1/testCompactionWithHFileLink=964f5813343e8a443a0a9846e8b60a1a-2040a0c0d6b74a2a84f36b91f50ba877 2023-02-09 16:55:44,912 DEBUG [StoreOpener-964f5813343e8a443a0a9846e8b60a1a-1] regionserver.HStore(539): loaded hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family1/testCompactionWithHFileLink=964f5813343e8a443a0a9846e8b60a1a-2f43f0ba911c4f1daa2bfa44de772d28 2023-02-09 16:55:44,920 DEBUG [StoreOpener-964f5813343e8a443a0a9846e8b60a1a-1] regionserver.HStore(539): loaded hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family1/testCompactionWithHFileLink=964f5813343e8a443a0a9846e8b60a1a-91b9b6b408b346eebf03b112c14765f1 2023-02-09 16:55:44,922 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] throttle.PressureAwareThroughputController(145): ff109ff5b69a09236d8e26cac06ad183#family1#compaction#114 average throughput is 0.78 MB/second, slept 0 time(s) and total slept time is 0 ms. 1 active operations remaining, total limit is 50.00 MB/second 2023-02-09 16:55:44,922 INFO [RS:0;jenkins-hbase4:35511-longCompactions-0] throttle.PressureAwareThroughputController(145): ff109ff5b69a09236d8e26cac06ad183#family2#compaction#115 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 16:55:44,939 DEBUG [StoreOpener-964f5813343e8a443a0a9846e8b60a1a-1] regionserver.HStore(539): loaded hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family1/testCompactionWithHFileLink=964f5813343e8a443a0a9846e8b60a1a-cdc0da56512c47e9905d91d398ff9cee 2023-02-09 16:55:44,939 INFO [StoreOpener-964f5813343e8a443a0a9846e8b60a1a-1] regionserver.HStore(310): Store=964f5813343e8a443a0a9846e8b60a1a/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 16:55:44,940 INFO [StoreOpener-964f5813343e8a443a0a9846e8b60a1a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 964f5813343e8a443a0a9846e8b60a1a 2023-02-09 16:55:44,940 DEBUG [StoreOpener-964f5813343e8a443a0a9846e8b60a1a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family2 2023-02-09 16:55:44,941 DEBUG [StoreOpener-964f5813343e8a443a0a9846e8b60a1a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family2 2023-02-09 16:55:44,941 INFO [StoreOpener-964f5813343e8a443a0a9846e8b60a1a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 964f5813343e8a443a0a9846e8b60a1a columnFamilyName family2 2023-02-09 16:55:44,949 DEBUG [StoreOpener-964f5813343e8a443a0a9846e8b60a1a-1] regionserver.HStore(539): loaded hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family2/testCompactionWithHFileLink=964f5813343e8a443a0a9846e8b60a1a-41872818fa124596bdceeb9e4d43509d 2023-02-09 16:55:44,953 DEBUG [StoreOpener-964f5813343e8a443a0a9846e8b60a1a-1] regionserver.HStore(539): loaded hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family2/testCompactionWithHFileLink=964f5813343e8a443a0a9846e8b60a1a-61d7c5d467734196aaf47bb8a75ee866 2023-02-09 16:55:44,958 DEBUG [StoreOpener-964f5813343e8a443a0a9846e8b60a1a-1] regionserver.HStore(539): loaded hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family2/testCompactionWithHFileLink=964f5813343e8a443a0a9846e8b60a1a-6a91dabe164b468b8eb198799372a729 2023-02-09 16:55:44,962 DEBUG [StoreOpener-964f5813343e8a443a0a9846e8b60a1a-1] regionserver.HStore(539): loaded hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family2/testCompactionWithHFileLink=964f5813343e8a443a0a9846e8b60a1a-6c223c6d2b8747279825b472ebbe3b88 2023-02-09 16:55:44,962 INFO [StoreOpener-964f5813343e8a443a0a9846e8b60a1a-1] regionserver.HStore(310): Store=964f5813343e8a443a0a9846e8b60a1a/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 16:55:44,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a 2023-02-09 16:55:44,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a 2023-02-09 16:55:44,965 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 16:55:44,966 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 964f5813343e8a443a0a9846e8b60a1a 2023-02-09 16:55:44,967 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 964f5813343e8a443a0a9846e8b60a1a; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68639560, jitterRate=0.022809147834777832}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 16:55:44,967 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 964f5813343e8a443a0a9846e8b60a1a: Running coprocessor pre-open hook at 1675961744885Writing region info on filesystem at 1675961744885Initializing all the Stores at 1675961744886 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675961744886Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675961744886Cleaning up temporary data from old regions at 1675961744964 (+78 ms)Cleaning up detritus from prior splits at 1675961744965 (+1 ms)Running coprocessor post-open hooks at 1675961744967 (+2 ms)Region opened successfully at 1675961744967 2023-02-09 16:55:44,967 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,,1675961720347.964f5813343e8a443a0a9846e8b60a1a., pid=103, masterSystemTime=1675961744798 2023-02-09 16:55:44,967 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-02-09 16:55:44,967 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-02-09 16:55:44,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,,1675961720347.964f5813343e8a443a0a9846e8b60a1a. 2023-02-09 16:55:44,969 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,,1675961720347.964f5813343e8a443a0a9846e8b60a1a. 2023-02-09 16:55:44,969 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,2,1675961720347.8f50653056db0fc97159c3a723710554. 2023-02-09 16:55:44,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 8f50653056db0fc97159c3a723710554, NAME => 'testCompactionWithHFileLink,2,1675961720347.8f50653056db0fc97159c3a723710554.', STARTKEY => '2', ENDKEY => ''} 2023-02-09 16:55:44,969 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=964f5813343e8a443a0a9846e8b60a1a, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:44,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 8f50653056db0fc97159c3a723710554 2023-02-09 16:55:44,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,2,1675961720347.8f50653056db0fc97159c3a723710554.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 16:55:44,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 8f50653056db0fc97159c3a723710554 2023-02-09 16:55:44,969 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1675961720347.964f5813343e8a443a0a9846e8b60a1a.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675961744969"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675961744969"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675961744969"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675961744969"}]},"ts":"1675961744969"} 2023-02-09 16:55:44,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 8f50653056db0fc97159c3a723710554 2023-02-09 16:55:44,971 INFO [StoreOpener-8f50653056db0fc97159c3a723710554-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 8f50653056db0fc97159c3a723710554 2023-02-09 16:55:44,972 DEBUG [StoreOpener-8f50653056db0fc97159c3a723710554-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1 2023-02-09 16:55:44,972 DEBUG [StoreOpener-8f50653056db0fc97159c3a723710554-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1 2023-02-09 16:55:44,972 INFO [StoreOpener-8f50653056db0fc97159c3a723710554-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8f50653056db0fc97159c3a723710554 columnFamilyName family1 2023-02-09 16:55:44,972 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=98 2023-02-09 16:55:44,972 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=98, state=SUCCESS; OpenRegionProcedure 964f5813343e8a443a0a9846e8b60a1a, server=jenkins-hbase4.apache.org,35511,1675961620699 in 323 msec 2023-02-09 16:55:44,973 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=98, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=964f5813343e8a443a0a9846e8b60a1a, ASSIGN in 482 msec 2023-02-09 16:55:44,978 DEBUG [StoreOpener-8f50653056db0fc97159c3a723710554-1] regionserver.HStore(539): loaded hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1/testCompactionWithHFileLink=8f50653056db0fc97159c3a723710554-95fe8fee4073477c8d575821319f6012 2023-02-09 16:55:44,983 DEBUG [StoreOpener-8f50653056db0fc97159c3a723710554-1] regionserver.HStore(539): loaded hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1/testCompactionWithHFileLink=8f50653056db0fc97159c3a723710554-9960ca25ee884e899d44d73e77321d91 2023-02-09 16:55:44,987 DEBUG [StoreOpener-8f50653056db0fc97159c3a723710554-1] regionserver.HStore(539): loaded hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1/testCompactionWithHFileLink=8f50653056db0fc97159c3a723710554-b5696cb1277d4b3f9d2aaf063efb7dbd 2023-02-09 16:55:44,993 DEBUG [StoreOpener-8f50653056db0fc97159c3a723710554-1] regionserver.HStore(539): loaded hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1/testCompactionWithHFileLink=8f50653056db0fc97159c3a723710554-bbd66b2a75854d769f68ec967526f8e4 2023-02-09 16:55:44,993 INFO [StoreOpener-8f50653056db0fc97159c3a723710554-1] regionserver.HStore(310): Store=8f50653056db0fc97159c3a723710554/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 16:55:44,993 INFO [StoreOpener-8f50653056db0fc97159c3a723710554-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 8f50653056db0fc97159c3a723710554 2023-02-09 16:55:44,994 DEBUG [StoreOpener-8f50653056db0fc97159c3a723710554-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family2 2023-02-09 16:55:44,994 DEBUG [StoreOpener-8f50653056db0fc97159c3a723710554-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family2 2023-02-09 16:55:44,994 INFO [StoreOpener-8f50653056db0fc97159c3a723710554-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8f50653056db0fc97159c3a723710554 columnFamilyName family2 2023-02-09 16:55:45,001 DEBUG [StoreOpener-8f50653056db0fc97159c3a723710554-1] regionserver.HStore(539): loaded hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family2/testCompactionWithHFileLink=8f50653056db0fc97159c3a723710554-1c3a8a6e6ea44571b8fda362269e1731 2023-02-09 16:55:45,006 DEBUG [StoreOpener-8f50653056db0fc97159c3a723710554-1] regionserver.HStore(539): loaded hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family2/testCompactionWithHFileLink=8f50653056db0fc97159c3a723710554-253a38900d1948339df6cb97b5c85255 2023-02-09 16:55:45,012 DEBUG [StoreOpener-8f50653056db0fc97159c3a723710554-1] regionserver.HStore(539): loaded hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family2/testCompactionWithHFileLink=8f50653056db0fc97159c3a723710554-2b4aaa427870487695f27db022840756 2023-02-09 16:55:45,018 DEBUG [StoreOpener-8f50653056db0fc97159c3a723710554-1] regionserver.HStore(539): loaded hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family2/testCompactionWithHFileLink=8f50653056db0fc97159c3a723710554-83269f5b6253457b801063cde566d9a5 2023-02-09 16:55:45,018 INFO [StoreOpener-8f50653056db0fc97159c3a723710554-1] regionserver.HStore(310): Store=8f50653056db0fc97159c3a723710554/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 16:55:45,019 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554 2023-02-09 16:55:45,020 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554 2023-02-09 16:55:45,021 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 16:55:45,022 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 8f50653056db0fc97159c3a723710554 2023-02-09 16:55:45,022 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 8f50653056db0fc97159c3a723710554; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61248950, jitterRate=-0.0873195230960846}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 16:55:45,022 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 8f50653056db0fc97159c3a723710554: Running coprocessor pre-open hook at 1675961744970Writing region info on filesystem at 1675961744970Initializing all the Stores at 1675961744970Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675961744970Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675961744971 (+1 ms)Cleaning up temporary data from old regions at 1675961745020 (+49 ms)Cleaning up detritus from prior splits at 1675961745020Running coprocessor post-open hooks at 1675961745022 (+2 ms)Region opened successfully at 1675961745022 2023-02-09 16:55:45,023 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,2,1675961720347.8f50653056db0fc97159c3a723710554., pid=102, masterSystemTime=1675961744798 2023-02-09 16:55:45,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-02-09 16:55:45,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-02-09 16:55:45,025 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,2,1675961720347.8f50653056db0fc97159c3a723710554. 2023-02-09 16:55:45,025 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,2,1675961720347.8f50653056db0fc97159c3a723710554. 2023-02-09 16:55:45,025 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=8f50653056db0fc97159c3a723710554, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:45,025 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1675961720347.8f50653056db0fc97159c3a723710554.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675961745025"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675961745025"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675961745025"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675961745025"}]},"ts":"1675961745025"} 2023-02-09 16:55:45,027 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-02-09 16:55:45,027 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; OpenRegionProcedure 8f50653056db0fc97159c3a723710554, server=jenkins-hbase4.apache.org,35511,1675961620699 in 379 msec 2023-02-09 16:55:45,029 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=100, resume processing ppid=97 2023-02-09 16:55:45,029 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=8f50653056db0fc97159c3a723710554, ASSIGN in 537 msec 2023-02-09 16:55:45,029 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675961745029"}]},"ts":"1675961745029"} 2023-02-09 16:55:45,030 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-02-09 16:55:45,031 INFO [PEWorker-5] procedure.EnableTableProcedure(310): Table 'testCompactionWithHFileLink' was successfully enabled. 2023-02-09 16:55:45,033 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; EnableTableProcedure table=testCompactionWithHFileLink in 553 msec 2023-02-09 16:55:45,090 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:45,090 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:45,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-02-09 16:55:45,091 INFO [Listener at localhost/41619] client.HBaseAdmin$TableFuture(3541): Operation: ENABLE, Table Name: default:testCompactionWithHFileLink, procId: 97 completed 2023-02-09 16:55:45,102 DEBUG [Listener at localhost/41619] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-09 16:55:45,110 DEBUG [Listener at localhost/41619] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-09 16:55:45,117 DEBUG [Listener at localhost/41619] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-09 16:55:45,118 DEBUG [Listener at localhost/41619] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-09 16:55:45,125 INFO [Listener at localhost/41619] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-09 16:55:45,139 INFO [Listener at localhost/41619] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-02-09 16:55:45,139 INFO [Listener at localhost/41619] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testCompactionWithHFileLink' column='family1' 2023-02-09 16:55:45,139 DEBUG [Listener at localhost/41619] zookeeper.ReadOnlyZKClient(139): Connect 0x1446083d to 127.0.0.1:53887 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 16:55:45,144 DEBUG [Listener at localhost/41619] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@ffaf8df, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 16:55:45,144 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230209 for table='testCompactionWithHFileLink' and column='family1' 2023-02-09 16:55:45,144 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230209 for table='testCompactionWithHFileLink' and column='family1' 2023-02-09 16:55:45,144 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230209 for table='testCompactionWithHFileLink' and column='family1' 2023-02-09 16:55:45,358 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/.tmp/family1/24d1f47d313349aca628dfbc97d6efe1 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family1/24d1f47d313349aca628dfbc97d6efe1 2023-02-09 16:55:45,362 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-02-09 16:55:45,363 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in ff109ff5b69a09236d8e26cac06ad183/family1 of ff109ff5b69a09236d8e26cac06ad183 into 24d1f47d313349aca628dfbc97d6efe1(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-09 16:55:45,363 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for ff109ff5b69a09236d8e26cac06ad183: 2023-02-09 16:55:45,363 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1675961720347.ff109ff5b69a09236d8e26cac06ad183., storeName=ff109ff5b69a09236d8e26cac06ad183/family1, priority=12, startTime=1675961744874; duration=0sec 2023-02-09 16:55:45,363 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-02-09 16:55:45,364 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-02-09 16:55:45,365 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-02-09 16:55:45,366 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HStore(1912): 964f5813343e8a443a0a9846e8b60a1a/family1 is initiating minor compaction (all files) 2023-02-09 16:55:45,366 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 964f5813343e8a443a0a9846e8b60a1a/family1 in testCompactionWithHFileLink,,1675961720347.964f5813343e8a443a0a9846e8b60a1a. 2023-02-09 16:55:45,366 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family1/testCompactionWithHFileLink=964f5813343e8a443a0a9846e8b60a1a-cdc0da56512c47e9905d91d398ff9cee, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family1/testCompactionWithHFileLink=964f5813343e8a443a0a9846e8b60a1a-2040a0c0d6b74a2a84f36b91f50ba877, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family1/testCompactionWithHFileLink=964f5813343e8a443a0a9846e8b60a1a-91b9b6b408b346eebf03b112c14765f1, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family1/testCompactionWithHFileLink=964f5813343e8a443a0a9846e8b60a1a-2f43f0ba911c4f1daa2bfa44de772d28] into tmpdir=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/.tmp, totalSize=21.6 K 2023-02-09 16:55:45,366 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=964f5813343e8a443a0a9846e8b60a1a-cdc0da56512c47e9905d91d398ff9cee, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675961722463 2023-02-09 16:55:45,367 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=964f5813343e8a443a0a9846e8b60a1a-2040a0c0d6b74a2a84f36b91f50ba877, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675961723846 2023-02-09 16:55:45,367 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=964f5813343e8a443a0a9846e8b60a1a-91b9b6b408b346eebf03b112c14765f1, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675961725623 2023-02-09 16:55:45,368 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=964f5813343e8a443a0a9846e8b60a1a-2f43f0ba911c4f1daa2bfa44de772d28, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675961727415 2023-02-09 16:55:45,380 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] throttle.PressureAwareThroughputController(145): 964f5813343e8a443a0a9846e8b60a1a#family1#compaction#116 average throughput is 1.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 16:55:45,389 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family1/testCompactionWithHFileLink=ff109ff5b69a09236d8e26cac06ad183-23928677550e4b8d89458a32e18e9063, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family1/testCompactionWithHFileLink=ff109ff5b69a09236d8e26cac06ad183-803335f8c9474fcf8a2ea08851a991db, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family1/testCompactionWithHFileLink=ff109ff5b69a09236d8e26cac06ad183-4b47145a05c04482887ccb260167014f, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family1/testCompactionWithHFileLink=ff109ff5b69a09236d8e26cac06ad183-c9eca6421ae74a5d83702f06efa00d4f] to archive 2023-02-09 16:55:45,389 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 16:55:45,391 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family1/testCompactionWithHFileLink=ff109ff5b69a09236d8e26cac06ad183-23928677550e4b8d89458a32e18e9063 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family1/testCompactionWithHFileLink=ff109ff5b69a09236d8e26cac06ad183-23928677550e4b8d89458a32e18e9063 2023-02-09 16:55:45,392 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family1/testCompactionWithHFileLink=ff109ff5b69a09236d8e26cac06ad183-803335f8c9474fcf8a2ea08851a991db to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family1/testCompactionWithHFileLink=ff109ff5b69a09236d8e26cac06ad183-803335f8c9474fcf8a2ea08851a991db 2023-02-09 16:55:45,393 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family1/testCompactionWithHFileLink=ff109ff5b69a09236d8e26cac06ad183-4b47145a05c04482887ccb260167014f to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family1/testCompactionWithHFileLink=ff109ff5b69a09236d8e26cac06ad183-4b47145a05c04482887ccb260167014f 2023-02-09 16:55:45,394 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family1/testCompactionWithHFileLink=ff109ff5b69a09236d8e26cac06ad183-c9eca6421ae74a5d83702f06efa00d4f to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family1/testCompactionWithHFileLink=ff109ff5b69a09236d8e26cac06ad183-c9eca6421ae74a5d83702f06efa00d4f 2023-02-09 16:55:45,613 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302098162eb74e4df4044b4d34a67fe24b024 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302098162eb74e4df4044b4d34a67fe24b024 2023-02-09 16:55:45,614 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230209 table='testCompactionWithHFileLink' column='family1' 2023-02-09 16:55:45,615 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302096dd42bedc1294abfb8e4979a182c8173 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302096dd42bedc1294abfb8e4979a182c8173 2023-02-09 16:55:45,616 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230209 table='testCompactionWithHFileLink' column='family1' 2023-02-09 16:55:45,626 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 16:55:45,630 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34734, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 16:55:45,635 INFO [MobFileCompactionChore-pool-2] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:45,635 INFO [MobFileCompactionChore-pool-2] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:45,635 INFO [MobFileCompactionChore-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:45,635 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-09 16:55:45,642 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34404, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-09 16:55:45,643 INFO [MobFileCompactionChore-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:45,643 INFO [MobFileCompactionChore-pool-0] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:45,660 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230209/family1/0ef0d875e6e146cd9a08cd7da25f45dd first=Optional[1\x00\x00\x00\x00] last=Optional[1\x00\x00\x00\x07] 2023-02-09 16:55:45,660 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230209/family1/d6696ed906254166978c880d3b28a418 first=Optional[0\x00\x00\x00\x00] last=Optional[0\x00\x00\x00\x07] 2023-02-09 16:55:45,661 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,1,1675961720347.ff109ff5b69a09236d8e26cac06ad183., hostname=jenkins-hbase4.apache.org,35511,1675961620699, seqNum=32 for row 1 with hfile group [{family1,hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230209/family1/0ef0d875e6e146cd9a08cd7da25f45dd}] 2023-02-09 16:55:45,661 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,,1675961720347.964f5813343e8a443a0a9846e8b60a1a., hostname=jenkins-hbase4.apache.org,35511,1675961620699, seqNum=32 for row with hfile group [{family1,hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230209/family1/d6696ed906254166978c880d3b28a418}] 2023-02-09 16:55:45,669 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(763): Validating hfile at hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230209/family1/d6696ed906254166978c880d3b28a418 for inclusion in 964f5813343e8a443a0a9846e8b60a1a/family1 2023-02-09 16:55:45,669 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35511] regionserver.HStore(763): Validating hfile at hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230209/family1/0ef0d875e6e146cd9a08cd7da25f45dd for inclusion in ff109ff5b69a09236d8e26cac06ad183/family1 2023-02-09 16:55:45,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x00 last=0\x00\x00\x00\x07 2023-02-09 16:55:45,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35511] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x00 last=1\x00\x00\x00\x07 2023-02-09 16:55:45,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(777): Region bounds: first= last=1 2023-02-09 16:55:45,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35511] regionserver.HStore(777): Region bounds: first=1 last=2 2023-02-09 16:55:45,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HRegion(2445): Flush status journal for 964f5813343e8a443a0a9846e8b60a1a: 2023-02-09 16:55:45,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35511] regionserver.HRegion(2445): Flush status journal for ff109ff5b69a09236d8e26cac06ad183: 2023-02-09 16:55:45,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230209/family1/d6696ed906254166978c880d3b28a418 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testCompactionWithHFileLink__p60rai0btuf9n1r5nrrh1mlguhrhcnjahgsjarhcas2pegksudb3muu16cm00a8f/family1/d6696ed906254166978c880d3b28a418 2023-02-09 16:55:45,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35511] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230209/family1/0ef0d875e6e146cd9a08cd7da25f45dd to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testCompactionWithHFileLink__ffaagu0vvji3lkbvuufo4ugkjadis9ferq24v2mpmgfs8buku8lc751hvg15agij/family1/0ef0d875e6e146cd9a08cd7da25f45dd 2023-02-09 16:55:45,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testCompactionWithHFileLink__p60rai0btuf9n1r5nrrh1mlguhrhcnjahgsjarhcas2pegksudb3muu16cm00a8f/family1/d6696ed906254166978c880d3b28a418 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family1/901f7a718f26468a99f8a6d53684d5f7_SeqId_34_ 2023-02-09 16:55:45,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35511] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testCompactionWithHFileLink__ffaagu0vvji3lkbvuufo4ugkjadis9ferq24v2mpmgfs8buku8lc751hvg15agij/family1/0ef0d875e6e146cd9a08cd7da25f45dd as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family1/1083b91cf8234fda834f21505b341005_SeqId_35_ 2023-02-09 16:55:45,674 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(849): Loaded HFile hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testCompactionWithHFileLink__p60rai0btuf9n1r5nrrh1mlguhrhcnjahgsjarhcas2pegksudb3muu16cm00a8f/family1/d6696ed906254166978c880d3b28a418 into 964f5813343e8a443a0a9846e8b60a1a/family1 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family1/901f7a718f26468a99f8a6d53684d5f7_SeqId_34_ - updating store file list. 2023-02-09 16:55:45,674 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35511] regionserver.HStore(849): Loaded HFile hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testCompactionWithHFileLink__ffaagu0vvji3lkbvuufo4ugkjadis9ferq24v2mpmgfs8buku8lc751hvg15agij/family1/0ef0d875e6e146cd9a08cd7da25f45dd into ff109ff5b69a09236d8e26cac06ad183/family1 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family1/1083b91cf8234fda834f21505b341005_SeqId_35_ - updating store file list. 2023-02-09 16:55:45,677 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(882): Loaded HFile hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family1/901f7a718f26468a99f8a6d53684d5f7_SeqId_34_ into 964f5813343e8a443a0a9846e8b60a1a/family1 2023-02-09 16:55:45,677 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(855): Successfully loaded hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testCompactionWithHFileLink__p60rai0btuf9n1r5nrrh1mlguhrhcnjahgsjarhcas2pegksudb3muu16cm00a8f/family1/d6696ed906254166978c880d3b28a418 into 964f5813343e8a443a0a9846e8b60a1a/family1 (new location: hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family1/901f7a718f26468a99f8a6d53684d5f7_SeqId_34_) 2023-02-09 16:55:45,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testCompactionWithHFileLink__p60rai0btuf9n1r5nrrh1mlguhrhcnjahgsjarhcas2pegksudb3muu16cm00a8f/family1/d6696ed906254166978c880d3b28a418 2023-02-09 16:55:45,678 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35511] regionserver.HStore(882): Loaded HFile hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family1/1083b91cf8234fda834f21505b341005_SeqId_35_ into ff109ff5b69a09236d8e26cac06ad183/family1 2023-02-09 16:55:45,678 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35511] regionserver.HStore(855): Successfully loaded hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testCompactionWithHFileLink__ffaagu0vvji3lkbvuufo4ugkjadis9ferq24v2mpmgfs8buku8lc751hvg15agij/family1/0ef0d875e6e146cd9a08cd7da25f45dd into ff109ff5b69a09236d8e26cac06ad183/family1 (new location: hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family1/1083b91cf8234fda834f21505b341005_SeqId_35_) 2023-02-09 16:55:45,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35511] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testCompactionWithHFileLink__ffaagu0vvji3lkbvuufo4ugkjadis9ferq24v2mpmgfs8buku8lc751hvg15agij/family1/0ef0d875e6e146cd9a08cd7da25f45dd 2023-02-09 16:55:45,680 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230209 table='testCompactionWithHFileLink' column='family1' 2023-02-09 16:55:45,680 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230209 table='testCompactionWithHFileLink' column='family1' 2023-02-09 16:55:45,680 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 16:55:45,681 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 16:55:45,682 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202302090b627555e2784172917cd94efc2d6532 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202302090b627555e2784172917cd94efc2d6532 2023-02-09 16:55:45,682 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023020920cc890cd42446f29aa42a9853cbea21 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023020920cc890cd42446f29aa42a9853cbea21 2023-02-09 16:55:45,683 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023020981776dbf549d496f905da8431c141ba1 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023020981776dbf549d496f905da8431c141ba1 2023-02-09 16:55:45,683 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023020929b05f21007847e19c056e5dd4865367 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023020929b05f21007847e19c056e5dd4865367 2023-02-09 16:55:45,684 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230209c06eb6440a0b47869da46e27ce12e759 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230209c06eb6440a0b47869da46e27ce12e759 2023-02-09 16:55:45,684 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202302095021cf77926d4cc381f0f752f0dacf42 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202302095021cf77926d4cc381f0f752f0dacf42 2023-02-09 16:55:45,685 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230209cdaa8e47ff974e13abc12d6b32848b7f to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230209cdaa8e47ff974e13abc12d6b32848b7f 2023-02-09 16:55:45,685 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230209a1c3b9e7c7924e958bf64ca5d6182f60 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230209a1c3b9e7c7924e958bf64ca5d6182f60 2023-02-09 16:55:45,685 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-09 16:55:45,685 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230209' 2023-02-09 16:55:45,685 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-09 16:55:45,686 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230209' 2023-02-09 16:55:45,686 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230209 for table='testCompactionWithHFileLink' and column='family1' 2023-02-09 16:55:45,686 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230209 for table='testCompactionWithHFileLink' and column='family1' 2023-02-09 16:55:46,007 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230209a0cff2a4eec64858b9f507ee36d61721 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230209a0cff2a4eec64858b9f507ee36d61721 2023-02-09 16:55:46,007 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230209 table='testCompactionWithHFileLink' column='family1' 2023-02-09 16:55:46,027 INFO [MobFileCompactionChore-pool-1] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:46,027 INFO [MobFileCompactionChore-pool-1] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:46,040 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230209/family1/58cc8df282154e3795426a56b1e0e374 first=Optional[2\x00\x00\x00\x00] last=Optional[2\x00\x00\x00\x07] 2023-02-09 16:55:46,040 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,2,1675961720347.8f50653056db0fc97159c3a723710554., hostname=jenkins-hbase4.apache.org,35511,1675961620699, seqNum=32 for row 2 with hfile group [{family1,hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230209/family1/58cc8df282154e3795426a56b1e0e374}] 2023-02-09 16:55:46,043 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(763): Validating hfile at hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230209/family1/58cc8df282154e3795426a56b1e0e374 for inclusion in 8f50653056db0fc97159c3a723710554/family1 2023-02-09 16:55:46,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x00 last=2\x00\x00\x00\x07 2023-02-09 16:55:46,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(777): Region bounds: first=2 last= 2023-02-09 16:55:46,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HRegion(2445): Flush status journal for 8f50653056db0fc97159c3a723710554: 2023-02-09 16:55:46,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230209/family1/58cc8df282154e3795426a56b1e0e374 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testCompactionWithHFileLink__fhqspim18s1rtb3h7tk5imt1km3m9ik2nb5udl5m4sih772k2psl01ij1gc46bgm/family1/58cc8df282154e3795426a56b1e0e374 2023-02-09 16:55:46,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testCompactionWithHFileLink__fhqspim18s1rtb3h7tk5imt1km3m9ik2nb5udl5m4sih772k2psl01ij1gc46bgm/family1/58cc8df282154e3795426a56b1e0e374 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1/c14786c1729f4e71812174e1a53cef93_SeqId_34_ 2023-02-09 16:55:46,050 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(849): Loaded HFile hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testCompactionWithHFileLink__fhqspim18s1rtb3h7tk5imt1km3m9ik2nb5udl5m4sih772k2psl01ij1gc46bgm/family1/58cc8df282154e3795426a56b1e0e374 into 8f50653056db0fc97159c3a723710554/family1 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1/c14786c1729f4e71812174e1a53cef93_SeqId_34_ - updating store file list. 2023-02-09 16:55:46,053 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(882): Loaded HFile hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1/c14786c1729f4e71812174e1a53cef93_SeqId_34_ into 8f50653056db0fc97159c3a723710554/family1 2023-02-09 16:55:46,053 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(855): Successfully loaded hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testCompactionWithHFileLink__fhqspim18s1rtb3h7tk5imt1km3m9ik2nb5udl5m4sih772k2psl01ij1gc46bgm/family1/58cc8df282154e3795426a56b1e0e374 into 8f50653056db0fc97159c3a723710554/family1 (new location: hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1/c14786c1729f4e71812174e1a53cef93_SeqId_34_) 2023-02-09 16:55:46,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testCompactionWithHFileLink__fhqspim18s1rtb3h7tk5imt1km3m9ik2nb5udl5m4sih772k2psl01ij1gc46bgm/family1/58cc8df282154e3795426a56b1e0e374 2023-02-09 16:55:46,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-09 16:55:46,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-02-09 16:55:46,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(1912): 8f50653056db0fc97159c3a723710554/family1 is initiating minor compaction (all files) 2023-02-09 16:55:46,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@4389b802; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-02-09 16:55:46,058 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230209 table='testCompactionWithHFileLink' column='family1' 2023-02-09 16:55:46,059 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 16:55:46,061 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c2023020926654af107cf4162ad4745bfa2f1ca26 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c2023020926654af107cf4162ad4745bfa2f1ca26 2023-02-09 16:55:46,062 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202302096bcc7efd6cc84d2fbda5375b5938e8be to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202302096bcc7efd6cc84d2fbda5375b5938e8be 2023-02-09 16:55:46,063 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202302099bcabcbba46349fb98ce3d3b3b7fe317 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202302099bcabcbba46349fb98ce3d3b3b7fe317 2023-02-09 16:55:46,064 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230209ecf6c4e2f15a431dba58fdc14222af40 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230209ecf6c4e2f15a431dba58fdc14222af40 2023-02-09 16:55:46,064 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-09 16:55:46,064 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230209' 2023-02-09 16:55:46,065 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230209 for table='testCompactionWithHFileLink' and column='family1' 2023-02-09 16:55:46,065 INFO [Listener at localhost/41619] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-02-09 16:55:46,067 DEBUG [Listener at localhost/41619] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-09 16:55:46,070 DEBUG [Listener at localhost/41619] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-09 16:55:46,073 DEBUG [Listener at localhost/41619] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-09 16:55:46,074 DEBUG [Listener at localhost/41619] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-09 16:55:46,080 DEBUG [Listener at localhost/41619] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-09 16:55:46,081 DEBUG [Listener at localhost/41619] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-09 16:55:46,100 INFO [Listener at localhost/41619] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=283 (was 244) - Thread LEAK? -, OpenFileDescriptor=740 (was 613) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=95 (was 125), ProcessCount=168 (was 168), AvailableMemoryMB=2938 (was 3024) 2023-02-09 16:55:46,113 INFO [Listener at localhost/41619] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompaction Thread=283, OpenFileDescriptor=740, MaxFileDescriptor=60000, SystemLoadAverage=95, ProcessCount=168, AvailableMemoryMB=2937 2023-02-09 16:55:46,114 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:46,114 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:46,118 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.HMaster$15(2997): Client=jenkins//172.31.14.131 creating {NAME => 'ns'} 2023-02-09 16:55:46,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=ns 2023-02-09 16:55:46,123 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:46,123 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:46,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=104 2023-02-09 16:55:46,126 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-09 16:55:46,128 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; CreateNamespaceProcedure, namespace=ns in 8 msec 2023-02-09 16:55:46,147 DEBUG [RS:0;jenkins-hbase4:35511-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/.tmp/family2/5f65e858cc4d48718d41f6a5251252d9 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family2/5f65e858cc4d48718d41f6a5251252d9 2023-02-09 16:55:46,151 INFO [RS:0;jenkins-hbase4:35511-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in ff109ff5b69a09236d8e26cac06ad183/family2 of ff109ff5b69a09236d8e26cac06ad183 into 5f65e858cc4d48718d41f6a5251252d9(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-09 16:55:46,151 DEBUG [RS:0;jenkins-hbase4:35511-longCompactions-0] regionserver.HRegion(2288): Compaction status journal for ff109ff5b69a09236d8e26cac06ad183: 2023-02-09 16:55:46,151 INFO [RS:0;jenkins-hbase4:35511-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1675961720347.ff109ff5b69a09236d8e26cac06ad183., storeName=ff109ff5b69a09236d8e26cac06ad183/family2, priority=12, startTime=1675961744875; duration=1sec 2023-02-09 16:55:46,151 DEBUG [RS:0;jenkins-hbase4:35511-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-02-09 16:55:46,151 INFO [RS:0;jenkins-hbase4:35511-longCompactions-0] regionserver.HRegion(2258): Starting compaction of 8f50653056db0fc97159c3a723710554/family1 in testCompactionWithHFileLink,2,1675961720347.8f50653056db0fc97159c3a723710554. 2023-02-09 16:55:46,151 INFO [RS:0;jenkins-hbase4:35511-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1/testCompactionWithHFileLink=8f50653056db0fc97159c3a723710554-9960ca25ee884e899d44d73e77321d91, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1/testCompactionWithHFileLink=8f50653056db0fc97159c3a723710554-bbd66b2a75854d769f68ec967526f8e4, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1/testCompactionWithHFileLink=8f50653056db0fc97159c3a723710554-95fe8fee4073477c8d575821319f6012, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1/testCompactionWithHFileLink=8f50653056db0fc97159c3a723710554-b5696cb1277d4b3f9d2aaf063efb7dbd, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1/c14786c1729f4e71812174e1a53cef93_SeqId_34_] into tmpdir=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/.tmp, totalSize=28.9 K 2023-02-09 16:55:46,152 DEBUG [RS:0;jenkins-hbase4:35511-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=8f50653056db0fc97159c3a723710554-9960ca25ee884e899d44d73e77321d91, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675961722465 2023-02-09 16:55:46,152 DEBUG [RS:0;jenkins-hbase4:35511-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=8f50653056db0fc97159c3a723710554-bbd66b2a75854d769f68ec967526f8e4, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675961723846 2023-02-09 16:55:46,153 DEBUG [RS:0;jenkins-hbase4:35511-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=8f50653056db0fc97159c3a723710554-95fe8fee4073477c8d575821319f6012, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675961725624 2023-02-09 16:55:46,153 DEBUG [RS:0;jenkins-hbase4:35511-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=8f50653056db0fc97159c3a723710554-b5696cb1277d4b3f9d2aaf063efb7dbd, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675961727415 2023-02-09 16:55:46,153 DEBUG [RS:0;jenkins-hbase4:35511-longCompactions-0] compactions.Compactor(207): Compacting c14786c1729f4e71812174e1a53cef93_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1675961722465 2023-02-09 16:55:46,165 INFO [RS:0;jenkins-hbase4:35511-longCompactions-0] throttle.PressureAwareThroughputController(145): 8f50653056db0fc97159c3a723710554#family1#compaction#117 average throughput is 1.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 16:55:46,194 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family2/testCompactionWithHFileLink=ff109ff5b69a09236d8e26cac06ad183-e1834c7e198d4a5492a909f9090dba11, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family2/testCompactionWithHFileLink=ff109ff5b69a09236d8e26cac06ad183-cf952d5d378641a494409f4684fd499b, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family2/testCompactionWithHFileLink=ff109ff5b69a09236d8e26cac06ad183-1339a57e456946d083bc26ef990b55e2, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family2/testCompactionWithHFileLink=ff109ff5b69a09236d8e26cac06ad183-3a4e6fb98efd4681973e25dee0f08c97] to archive 2023-02-09 16:55:46,194 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 16:55:46,196 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family2/testCompactionWithHFileLink=ff109ff5b69a09236d8e26cac06ad183-e1834c7e198d4a5492a909f9090dba11 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family2/testCompactionWithHFileLink=ff109ff5b69a09236d8e26cac06ad183-e1834c7e198d4a5492a909f9090dba11 2023-02-09 16:55:46,197 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family2/testCompactionWithHFileLink=ff109ff5b69a09236d8e26cac06ad183-cf952d5d378641a494409f4684fd499b to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family2/testCompactionWithHFileLink=ff109ff5b69a09236d8e26cac06ad183-cf952d5d378641a494409f4684fd499b 2023-02-09 16:55:46,197 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family2/testCompactionWithHFileLink=ff109ff5b69a09236d8e26cac06ad183-1339a57e456946d083bc26ef990b55e2 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family2/testCompactionWithHFileLink=ff109ff5b69a09236d8e26cac06ad183-1339a57e456946d083bc26ef990b55e2 2023-02-09 16:55:46,198 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family2/testCompactionWithHFileLink=ff109ff5b69a09236d8e26cac06ad183-3a4e6fb98efd4681973e25dee0f08c97 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/family2/testCompactionWithHFileLink=ff109ff5b69a09236d8e26cac06ad183-3a4e6fb98efd4681973e25dee0f08c97 2023-02-09 16:55:46,224 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:46,224 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:46,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=104 2023-02-09 16:55:46,225 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:46,225 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:46,227 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-02-09 16:55:46,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=ns:testMinorCompaction 2023-02-09 16:55:46,229 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 16:55:46,229 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "ns" qualifier: "testMinorCompaction" procId is: 105 2023-02-09 16:55:46,229 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:46,229 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:46,230 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 16:55:46,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-09 16:55:46,232 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008 2023-02-09 16:55:46,232 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008 empty. 2023-02-09 16:55:46,232 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9 2023-02-09 16:55:46,233 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008 2023-02-09 16:55:46,233 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9 empty. 2023-02-09 16:55:46,233 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d 2023-02-09 16:55:46,233 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9 2023-02-09 16:55:46,233 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d empty. 2023-02-09 16:55:46,233 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d 2023-02-09 16:55:46,233 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived ns:testMinorCompaction regions 2023-02-09 16:55:46,241 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/ns/testMinorCompaction/.tabledesc/.tableinfo.0000000001 2023-02-09 16:55:46,242 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(7671): creating {ENCODED => c804397231ed8faa5ea2759a18ad370d, NAME => 'ns:testMinorCompaction,2,1675961746226.c804397231ed8faa5ea2759a18ad370d.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp 2023-02-09 16:55:46,243 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(7671): creating {ENCODED => 89b5638a4d4b48414e2d99d1dafde008, NAME => 'ns:testMinorCompaction,,1675961746226.89b5638a4d4b48414e2d99d1dafde008.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp 2023-02-09 16:55:46,243 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(7671): creating {ENCODED => d5ef12f1d65f6f85f477fbd699fd3cf9, NAME => 'ns:testMinorCompaction,1,1675961746226.d5ef12f1d65f6f85f477fbd699fd3cf9.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp 2023-02-09 16:55:46,265 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,,1675961746226.89b5638a4d4b48414e2d99d1dafde008.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 16:55:46,265 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1603): Closing 89b5638a4d4b48414e2d99d1dafde008, disabling compactions & flushes 2023-02-09 16:55:46,265 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,,1675961746226.89b5638a4d4b48414e2d99d1dafde008. 2023-02-09 16:55:46,265 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,,1675961746226.89b5638a4d4b48414e2d99d1dafde008. 2023-02-09 16:55:46,265 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,,1675961746226.89b5638a4d4b48414e2d99d1dafde008. after waiting 0 ms 2023-02-09 16:55:46,265 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,,1675961746226.89b5638a4d4b48414e2d99d1dafde008. 2023-02-09 16:55:46,265 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1837): Closed ns:testMinorCompaction,,1675961746226.89b5638a4d4b48414e2d99d1dafde008. 2023-02-09 16:55:46,265 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1557): Region close journal for 89b5638a4d4b48414e2d99d1dafde008: Waiting for close lock at 1675961746265Disabling compacts and flushes for region at 1675961746265Disabling writes for close at 1675961746265Writing region close event to WAL at 1675961746265Closed at 1675961746265 2023-02-09 16:55:46,266 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,1,1675961746226.d5ef12f1d65f6f85f477fbd699fd3cf9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 16:55:46,266 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1603): Closing d5ef12f1d65f6f85f477fbd699fd3cf9, disabling compactions & flushes 2023-02-09 16:55:46,266 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,1,1675961746226.d5ef12f1d65f6f85f477fbd699fd3cf9. 2023-02-09 16:55:46,266 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,1,1675961746226.d5ef12f1d65f6f85f477fbd699fd3cf9. 2023-02-09 16:55:46,266 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,1,1675961746226.d5ef12f1d65f6f85f477fbd699fd3cf9. after waiting 0 ms 2023-02-09 16:55:46,266 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,1,1675961746226.d5ef12f1d65f6f85f477fbd699fd3cf9. 2023-02-09 16:55:46,266 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1837): Closed ns:testMinorCompaction,1,1675961746226.d5ef12f1d65f6f85f477fbd699fd3cf9. 2023-02-09 16:55:46,266 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1557): Region close journal for d5ef12f1d65f6f85f477fbd699fd3cf9: Waiting for close lock at 1675961746266Disabling compacts and flushes for region at 1675961746266Disabling writes for close at 1675961746266Writing region close event to WAL at 1675961746266Closed at 1675961746266 2023-02-09 16:55:46,330 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:46,331 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:46,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-09 16:55:46,532 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:46,532 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:46,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-09 16:55:46,597 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/.tmp/family1/a3857cad10ba4c22b4b5db00246e6da9 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family1/a3857cad10ba4c22b4b5db00246e6da9 2023-02-09 16:55:46,602 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 964f5813343e8a443a0a9846e8b60a1a/family1 of 964f5813343e8a443a0a9846e8b60a1a into a3857cad10ba4c22b4b5db00246e6da9(size=7.6 K), total size for store is 14.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-09 16:55:46,602 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 964f5813343e8a443a0a9846e8b60a1a: 2023-02-09 16:55:46,602 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1675961720347.964f5813343e8a443a0a9846e8b60a1a., storeName=964f5813343e8a443a0a9846e8b60a1a/family1, priority=12, startTime=1675961744967; duration=1sec 2023-02-09 16:55:46,602 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-02-09 16:55:46,603 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-02-09 16:55:46,605 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-02-09 16:55:46,605 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HStore(1912): 964f5813343e8a443a0a9846e8b60a1a/family2 is initiating minor compaction (all files) 2023-02-09 16:55:46,605 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 964f5813343e8a443a0a9846e8b60a1a/family2 in testCompactionWithHFileLink,,1675961720347.964f5813343e8a443a0a9846e8b60a1a. 2023-02-09 16:55:46,605 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family2/testCompactionWithHFileLink=964f5813343e8a443a0a9846e8b60a1a-6a91dabe164b468b8eb198799372a729, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family2/testCompactionWithHFileLink=964f5813343e8a443a0a9846e8b60a1a-61d7c5d467734196aaf47bb8a75ee866, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family2/testCompactionWithHFileLink=964f5813343e8a443a0a9846e8b60a1a-41872818fa124596bdceeb9e4d43509d, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family2/testCompactionWithHFileLink=964f5813343e8a443a0a9846e8b60a1a-6c223c6d2b8747279825b472ebbe3b88] into tmpdir=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/.tmp, totalSize=20.4 K 2023-02-09 16:55:46,606 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=964f5813343e8a443a0a9846e8b60a1a-6a91dabe164b468b8eb198799372a729, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675961722463 2023-02-09 16:55:46,606 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=964f5813343e8a443a0a9846e8b60a1a-61d7c5d467734196aaf47bb8a75ee866, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675961723846 2023-02-09 16:55:46,607 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=964f5813343e8a443a0a9846e8b60a1a-41872818fa124596bdceeb9e4d43509d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675961725623 2023-02-09 16:55:46,607 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=964f5813343e8a443a0a9846e8b60a1a-6c223c6d2b8747279825b472ebbe3b88, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675961727415 2023-02-09 16:55:46,629 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] throttle.PressureAwareThroughputController(145): 964f5813343e8a443a0a9846e8b60a1a#family2#compaction#118 average throughput is 0.15 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 16:55:46,658 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,2,1675961746226.c804397231ed8faa5ea2759a18ad370d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 16:55:46,658 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1603): Closing c804397231ed8faa5ea2759a18ad370d, disabling compactions & flushes 2023-02-09 16:55:46,658 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,2,1675961746226.c804397231ed8faa5ea2759a18ad370d. 2023-02-09 16:55:46,658 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,2,1675961746226.c804397231ed8faa5ea2759a18ad370d. 2023-02-09 16:55:46,658 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,2,1675961746226.c804397231ed8faa5ea2759a18ad370d. after waiting 0 ms 2023-02-09 16:55:46,658 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,2,1675961746226.c804397231ed8faa5ea2759a18ad370d. 2023-02-09 16:55:46,658 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1837): Closed ns:testMinorCompaction,2,1675961746226.c804397231ed8faa5ea2759a18ad370d. 2023-02-09 16:55:46,658 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1557): Region close journal for c804397231ed8faa5ea2759a18ad370d: Waiting for close lock at 1675961746658Disabling compacts and flushes for region at 1675961746658Disabling writes for close at 1675961746658Writing region close event to WAL at 1675961746658Closed at 1675961746658 2023-02-09 16:55:46,660 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 16:55:46,661 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,,1675961746226.89b5638a4d4b48414e2d99d1dafde008.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1675961746661"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675961746661"}]},"ts":"1675961746661"} 2023-02-09 16:55:46,661 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,1,1675961746226.d5ef12f1d65f6f85f477fbd699fd3cf9.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1675961746661"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675961746661"}]},"ts":"1675961746661"} 2023-02-09 16:55:46,661 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,2,1675961746226.c804397231ed8faa5ea2759a18ad370d.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1675961746661"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675961746661"}]},"ts":"1675961746661"} 2023-02-09 16:55:46,664 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-02-09 16:55:46,664 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 16:55:46,664 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675961746664"}]},"ts":"1675961746664"} 2023-02-09 16:55:46,665 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLING in hbase:meta 2023-02-09 16:55:46,668 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=89b5638a4d4b48414e2d99d1dafde008, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=d5ef12f1d65f6f85f477fbd699fd3cf9, ASSIGN}, {pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=c804397231ed8faa5ea2759a18ad370d, ASSIGN}] 2023-02-09 16:55:46,670 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=c804397231ed8faa5ea2759a18ad370d, ASSIGN 2023-02-09 16:55:46,670 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=d5ef12f1d65f6f85f477fbd699fd3cf9, ASSIGN 2023-02-09 16:55:46,670 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=89b5638a4d4b48414e2d99d1dafde008, ASSIGN 2023-02-09 16:55:46,671 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=c804397231ed8faa5ea2759a18ad370d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35511,1675961620699; forceNewPlan=false, retain=false 2023-02-09 16:55:46,671 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=d5ef12f1d65f6f85f477fbd699fd3cf9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35511,1675961620699; forceNewPlan=false, retain=false 2023-02-09 16:55:46,671 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=89b5638a4d4b48414e2d99d1dafde008, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35511,1675961620699; forceNewPlan=false, retain=false 2023-02-09 16:55:46,685 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family1/testCompactionWithHFileLink=964f5813343e8a443a0a9846e8b60a1a-cdc0da56512c47e9905d91d398ff9cee, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family1/testCompactionWithHFileLink=964f5813343e8a443a0a9846e8b60a1a-2040a0c0d6b74a2a84f36b91f50ba877, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family1/testCompactionWithHFileLink=964f5813343e8a443a0a9846e8b60a1a-91b9b6b408b346eebf03b112c14765f1, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family1/testCompactionWithHFileLink=964f5813343e8a443a0a9846e8b60a1a-2f43f0ba911c4f1daa2bfa44de772d28] to archive 2023-02-09 16:55:46,686 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 16:55:46,689 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family1/testCompactionWithHFileLink=964f5813343e8a443a0a9846e8b60a1a-cdc0da56512c47e9905d91d398ff9cee to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family1/testCompactionWithHFileLink=964f5813343e8a443a0a9846e8b60a1a-cdc0da56512c47e9905d91d398ff9cee 2023-02-09 16:55:46,690 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family1/testCompactionWithHFileLink=964f5813343e8a443a0a9846e8b60a1a-2040a0c0d6b74a2a84f36b91f50ba877 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family1/testCompactionWithHFileLink=964f5813343e8a443a0a9846e8b60a1a-2040a0c0d6b74a2a84f36b91f50ba877 2023-02-09 16:55:46,692 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family1/testCompactionWithHFileLink=964f5813343e8a443a0a9846e8b60a1a-91b9b6b408b346eebf03b112c14765f1 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family1/testCompactionWithHFileLink=964f5813343e8a443a0a9846e8b60a1a-91b9b6b408b346eebf03b112c14765f1 2023-02-09 16:55:46,694 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family1/testCompactionWithHFileLink=964f5813343e8a443a0a9846e8b60a1a-2f43f0ba911c4f1daa2bfa44de772d28 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family1/testCompactionWithHFileLink=964f5813343e8a443a0a9846e8b60a1a-2f43f0ba911c4f1daa2bfa44de772d28 2023-02-09 16:55:46,824 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=d5ef12f1d65f6f85f477fbd699fd3cf9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:46,824 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=89b5638a4d4b48414e2d99d1dafde008, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:46,824 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=c804397231ed8faa5ea2759a18ad370d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:46,824 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,,1675961746226.89b5638a4d4b48414e2d99d1dafde008.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1675961746823"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675961746823"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675961746823"}]},"ts":"1675961746823"} 2023-02-09 16:55:46,824 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,2,1675961746226.c804397231ed8faa5ea2759a18ad370d.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1675961746823"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675961746823"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675961746823"}]},"ts":"1675961746823"} 2023-02-09 16:55:46,824 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,1,1675961746226.d5ef12f1d65f6f85f477fbd699fd3cf9.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1675961746823"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675961746823"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675961746823"}]},"ts":"1675961746823"} 2023-02-09 16:55:46,825 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure 89b5638a4d4b48414e2d99d1dafde008, server=jenkins-hbase4.apache.org,35511,1675961620699}] 2023-02-09 16:55:46,826 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=110, ppid=108, state=RUNNABLE; OpenRegionProcedure c804397231ed8faa5ea2759a18ad370d, server=jenkins-hbase4.apache.org,35511,1675961620699}] 2023-02-09 16:55:46,826 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=111, ppid=107, state=RUNNABLE; OpenRegionProcedure d5ef12f1d65f6f85f477fbd699fd3cf9, server=jenkins-hbase4.apache.org,35511,1675961620699}] 2023-02-09 16:55:46,833 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:46,833 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:46,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-09 16:55:46,979 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,,1675961746226.89b5638a4d4b48414e2d99d1dafde008. 2023-02-09 16:55:46,979 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 89b5638a4d4b48414e2d99d1dafde008, NAME => 'ns:testMinorCompaction,,1675961746226.89b5638a4d4b48414e2d99d1dafde008.', STARTKEY => '', ENDKEY => '1'} 2023-02-09 16:55:46,979 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 89b5638a4d4b48414e2d99d1dafde008 2023-02-09 16:55:46,979 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,,1675961746226.89b5638a4d4b48414e2d99d1dafde008.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 16:55:46,979 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 89b5638a4d4b48414e2d99d1dafde008 2023-02-09 16:55:46,979 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 89b5638a4d4b48414e2d99d1dafde008 2023-02-09 16:55:46,980 INFO [StoreOpener-89b5638a4d4b48414e2d99d1dafde008-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 89b5638a4d4b48414e2d99d1dafde008 2023-02-09 16:55:46,981 DEBUG [StoreOpener-89b5638a4d4b48414e2d99d1dafde008-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/family1 2023-02-09 16:55:46,982 DEBUG [StoreOpener-89b5638a4d4b48414e2d99d1dafde008-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/family1 2023-02-09 16:55:46,982 INFO [StoreOpener-89b5638a4d4b48414e2d99d1dafde008-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 89b5638a4d4b48414e2d99d1dafde008 columnFamilyName family1 2023-02-09 16:55:46,983 INFO [StoreOpener-89b5638a4d4b48414e2d99d1dafde008-1] regionserver.HStore(310): Store=89b5638a4d4b48414e2d99d1dafde008/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 16:55:46,983 INFO [StoreOpener-89b5638a4d4b48414e2d99d1dafde008-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 89b5638a4d4b48414e2d99d1dafde008 2023-02-09 16:55:46,984 DEBUG [StoreOpener-89b5638a4d4b48414e2d99d1dafde008-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/family2 2023-02-09 16:55:46,984 DEBUG [StoreOpener-89b5638a4d4b48414e2d99d1dafde008-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/family2 2023-02-09 16:55:46,984 INFO [StoreOpener-89b5638a4d4b48414e2d99d1dafde008-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 89b5638a4d4b48414e2d99d1dafde008 columnFamilyName family2 2023-02-09 16:55:46,985 INFO [StoreOpener-89b5638a4d4b48414e2d99d1dafde008-1] regionserver.HStore(310): Store=89b5638a4d4b48414e2d99d1dafde008/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 16:55:46,986 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008 2023-02-09 16:55:46,986 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008 2023-02-09 16:55:46,987 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 16:55:46,988 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 89b5638a4d4b48414e2d99d1dafde008 2023-02-09 16:55:46,989 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 16:55:46,989 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 89b5638a4d4b48414e2d99d1dafde008; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72832212, jitterRate=0.0852845311164856}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 16:55:46,989 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 89b5638a4d4b48414e2d99d1dafde008: Running coprocessor pre-open hook at 1675961746980Writing region info on filesystem at 1675961746980Initializing all the Stores at 1675961746980Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675961746980Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675961746980Cleaning up temporary data from old regions at 1675961746986 (+6 ms)Cleaning up detritus from prior splits at 1675961746987 (+1 ms)Running coprocessor post-open hooks at 1675961746989 (+2 ms)Region opened successfully at 1675961746989 2023-02-09 16:55:46,990 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,,1675961746226.89b5638a4d4b48414e2d99d1dafde008., pid=109, masterSystemTime=1675961746977 2023-02-09 16:55:46,991 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,,1675961746226.89b5638a4d4b48414e2d99d1dafde008. 2023-02-09 16:55:46,991 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,,1675961746226.89b5638a4d4b48414e2d99d1dafde008. 2023-02-09 16:55:46,991 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,1,1675961746226.d5ef12f1d65f6f85f477fbd699fd3cf9. 2023-02-09 16:55:46,991 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d5ef12f1d65f6f85f477fbd699fd3cf9, NAME => 'ns:testMinorCompaction,1,1675961746226.d5ef12f1d65f6f85f477fbd699fd3cf9.', STARTKEY => '1', ENDKEY => '2'} 2023-02-09 16:55:46,992 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=89b5638a4d4b48414e2d99d1dafde008, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:46,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction d5ef12f1d65f6f85f477fbd699fd3cf9 2023-02-09 16:55:46,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,1,1675961746226.d5ef12f1d65f6f85f477fbd699fd3cf9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 16:55:46,992 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,,1675961746226.89b5638a4d4b48414e2d99d1dafde008.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1675961746992"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675961746992"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675961746992"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675961746992"}]},"ts":"1675961746992"} 2023-02-09 16:55:46,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for d5ef12f1d65f6f85f477fbd699fd3cf9 2023-02-09 16:55:46,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for d5ef12f1d65f6f85f477fbd699fd3cf9 2023-02-09 16:55:46,993 INFO [StoreOpener-d5ef12f1d65f6f85f477fbd699fd3cf9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region d5ef12f1d65f6f85f477fbd699fd3cf9 2023-02-09 16:55:46,994 DEBUG [StoreOpener-d5ef12f1d65f6f85f477fbd699fd3cf9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/family1 2023-02-09 16:55:46,994 DEBUG [StoreOpener-d5ef12f1d65f6f85f477fbd699fd3cf9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/family1 2023-02-09 16:55:46,994 INFO [StoreOpener-d5ef12f1d65f6f85f477fbd699fd3cf9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d5ef12f1d65f6f85f477fbd699fd3cf9 columnFamilyName family1 2023-02-09 16:55:46,994 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=106 2023-02-09 16:55:46,994 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure 89b5638a4d4b48414e2d99d1dafde008, server=jenkins-hbase4.apache.org,35511,1675961620699 in 168 msec 2023-02-09 16:55:46,995 INFO [StoreOpener-d5ef12f1d65f6f85f477fbd699fd3cf9-1] regionserver.HStore(310): Store=d5ef12f1d65f6f85f477fbd699fd3cf9/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 16:55:46,995 INFO [StoreOpener-d5ef12f1d65f6f85f477fbd699fd3cf9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region d5ef12f1d65f6f85f477fbd699fd3cf9 2023-02-09 16:55:46,995 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=89b5638a4d4b48414e2d99d1dafde008, ASSIGN in 326 msec 2023-02-09 16:55:46,996 DEBUG [StoreOpener-d5ef12f1d65f6f85f477fbd699fd3cf9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/family2 2023-02-09 16:55:46,996 DEBUG [StoreOpener-d5ef12f1d65f6f85f477fbd699fd3cf9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/family2 2023-02-09 16:55:46,996 INFO [StoreOpener-d5ef12f1d65f6f85f477fbd699fd3cf9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d5ef12f1d65f6f85f477fbd699fd3cf9 columnFamilyName family2 2023-02-09 16:55:46,997 INFO [StoreOpener-d5ef12f1d65f6f85f477fbd699fd3cf9-1] regionserver.HStore(310): Store=d5ef12f1d65f6f85f477fbd699fd3cf9/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 16:55:46,997 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9 2023-02-09 16:55:46,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9 2023-02-09 16:55:46,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 16:55:47,000 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for d5ef12f1d65f6f85f477fbd699fd3cf9 2023-02-09 16:55:47,001 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 16:55:47,001 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened d5ef12f1d65f6f85f477fbd699fd3cf9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66093039, jitterRate=-0.015136972069740295}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 16:55:47,001 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for d5ef12f1d65f6f85f477fbd699fd3cf9: Running coprocessor pre-open hook at 1675961746992Writing region info on filesystem at 1675961746992Initializing all the Stores at 1675961746992Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675961746993 (+1 ms)Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675961746993Cleaning up temporary data from old regions at 1675961746998 (+5 ms)Cleaning up detritus from prior splits at 1675961746998Running coprocessor post-open hooks at 1675961747001 (+3 ms)Region opened successfully at 1675961747001 2023-02-09 16:55:47,002 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,1,1675961746226.d5ef12f1d65f6f85f477fbd699fd3cf9., pid=111, masterSystemTime=1675961746977 2023-02-09 16:55:47,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,1,1675961746226.d5ef12f1d65f6f85f477fbd699fd3cf9. 2023-02-09 16:55:47,003 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,1,1675961746226.d5ef12f1d65f6f85f477fbd699fd3cf9. 2023-02-09 16:55:47,003 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,2,1675961746226.c804397231ed8faa5ea2759a18ad370d. 2023-02-09 16:55:47,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c804397231ed8faa5ea2759a18ad370d, NAME => 'ns:testMinorCompaction,2,1675961746226.c804397231ed8faa5ea2759a18ad370d.', STARTKEY => '2', ENDKEY => ''} 2023-02-09 16:55:47,003 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=d5ef12f1d65f6f85f477fbd699fd3cf9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:47,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction c804397231ed8faa5ea2759a18ad370d 2023-02-09 16:55:47,003 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,1,1675961746226.d5ef12f1d65f6f85f477fbd699fd3cf9.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1675961747003"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675961747003"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675961747003"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675961747003"}]},"ts":"1675961747003"} 2023-02-09 16:55:47,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,2,1675961746226.c804397231ed8faa5ea2759a18ad370d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 16:55:47,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for c804397231ed8faa5ea2759a18ad370d 2023-02-09 16:55:47,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for c804397231ed8faa5ea2759a18ad370d 2023-02-09 16:55:47,005 INFO [StoreOpener-c804397231ed8faa5ea2759a18ad370d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region c804397231ed8faa5ea2759a18ad370d 2023-02-09 16:55:47,006 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=111, resume processing ppid=107 2023-02-09 16:55:47,006 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=111, ppid=107, state=SUCCESS; OpenRegionProcedure d5ef12f1d65f6f85f477fbd699fd3cf9, server=jenkins-hbase4.apache.org,35511,1675961620699 in 179 msec 2023-02-09 16:55:47,006 DEBUG [StoreOpener-c804397231ed8faa5ea2759a18ad370d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/family1 2023-02-09 16:55:47,006 DEBUG [StoreOpener-c804397231ed8faa5ea2759a18ad370d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/family1 2023-02-09 16:55:47,006 INFO [StoreOpener-c804397231ed8faa5ea2759a18ad370d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c804397231ed8faa5ea2759a18ad370d columnFamilyName family1 2023-02-09 16:55:47,007 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=d5ef12f1d65f6f85f477fbd699fd3cf9, ASSIGN in 338 msec 2023-02-09 16:55:47,007 INFO [StoreOpener-c804397231ed8faa5ea2759a18ad370d-1] regionserver.HStore(310): Store=c804397231ed8faa5ea2759a18ad370d/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 16:55:47,007 INFO [StoreOpener-c804397231ed8faa5ea2759a18ad370d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region c804397231ed8faa5ea2759a18ad370d 2023-02-09 16:55:47,008 DEBUG [StoreOpener-c804397231ed8faa5ea2759a18ad370d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/family2 2023-02-09 16:55:47,008 DEBUG [StoreOpener-c804397231ed8faa5ea2759a18ad370d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/family2 2023-02-09 16:55:47,009 INFO [StoreOpener-c804397231ed8faa5ea2759a18ad370d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c804397231ed8faa5ea2759a18ad370d columnFamilyName family2 2023-02-09 16:55:47,009 INFO [StoreOpener-c804397231ed8faa5ea2759a18ad370d-1] regionserver.HStore(310): Store=c804397231ed8faa5ea2759a18ad370d/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 16:55:47,010 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d 2023-02-09 16:55:47,010 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d 2023-02-09 16:55:47,012 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 16:55:47,012 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for c804397231ed8faa5ea2759a18ad370d 2023-02-09 16:55:47,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 16:55:47,014 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened c804397231ed8faa5ea2759a18ad370d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60690835, jitterRate=-0.09563608467578888}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 16:55:47,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for c804397231ed8faa5ea2759a18ad370d: Running coprocessor pre-open hook at 1675961747004Writing region info on filesystem at 1675961747004Initializing all the Stores at 1675961747004Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675961747004Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675961747005 (+1 ms)Cleaning up temporary data from old regions at 1675961747011 (+6 ms)Cleaning up detritus from prior splits at 1675961747011Running coprocessor post-open hooks at 1675961747014 (+3 ms)Region opened successfully at 1675961747014 2023-02-09 16:55:47,015 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,2,1675961746226.c804397231ed8faa5ea2759a18ad370d., pid=110, masterSystemTime=1675961746977 2023-02-09 16:55:47,016 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,2,1675961746226.c804397231ed8faa5ea2759a18ad370d. 2023-02-09 16:55:47,016 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,2,1675961746226.c804397231ed8faa5ea2759a18ad370d. 2023-02-09 16:55:47,016 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=c804397231ed8faa5ea2759a18ad370d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:47,016 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,2,1675961746226.c804397231ed8faa5ea2759a18ad370d.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1675961747016"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675961747016"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675961747016"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675961747016"}]},"ts":"1675961747016"} 2023-02-09 16:55:47,018 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=110, resume processing ppid=108 2023-02-09 16:55:47,018 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=110, ppid=108, state=SUCCESS; OpenRegionProcedure c804397231ed8faa5ea2759a18ad370d, server=jenkins-hbase4.apache.org,35511,1675961620699 in 191 msec 2023-02-09 16:55:47,020 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=105 2023-02-09 16:55:47,020 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=c804397231ed8faa5ea2759a18ad370d, ASSIGN in 350 msec 2023-02-09 16:55:47,020 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 16:55:47,020 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675961747020"}]},"ts":"1675961747020"} 2023-02-09 16:55:47,021 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLED in hbase:meta 2023-02-09 16:55:47,024 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 16:55:47,025 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=ns:testMinorCompaction in 797 msec 2023-02-09 16:55:47,084 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-09 16:55:47,334 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:47,334 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:47,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-09 16:55:47,335 INFO [Listener at localhost/41619] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: ns:testMinorCompaction, procId: 105 completed 2023-02-09 16:55:47,340 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,,1675961746226.89b5638a4d4b48414e2d99d1dafde008. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 16:55:47,341 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,1,1675961746226.d5ef12f1d65f6f85f477fbd699fd3cf9. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 16:55:47,341 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,2,1675961746226.c804397231ed8faa5ea2759a18ad370d. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 16:55:47,343 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:47,343 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:47,343 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:55:47,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-02-09 16:55:47,345 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-02-09 16:55:47,345 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:55:47,345 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-02-09 16:55:47,345 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-02-09 16:55:47,345 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 16:55:47,345 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-09 16:55:47,346 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:55:47,346 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:47,346 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:55:47,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:55:47,347 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:47,347 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:55:47,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-09 16:55:47,347 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 16:55:47,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:55:47,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-09 16:55:47,347 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-02-09 16:55:47,348 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-02-09 16:55:47,348 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-02-09 16:55:47,348 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:55:47,348 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-02-09 16:55:47,348 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1675961746226.89b5638a4d4b48414e2d99d1dafde008. 2023-02-09 16:55:47,348 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1675961746226.c804397231ed8faa5ea2759a18ad370d. 2023-02-09 16:55:47,348 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1675961746226.d5ef12f1d65f6f85f477fbd699fd3cf9. 2023-02-09 16:55:47,348 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1675961746226.89b5638a4d4b48414e2d99d1dafde008. started... 2023-02-09 16:55:47,348 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-09 16:55:47,348 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:55:47,348 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1675961746226.d5ef12f1d65f6f85f477fbd699fd3cf9. started... 2023-02-09 16:55:47,350 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 89b5638a4d4b48414e2d99d1dafde008 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-09 16:55:47,348 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1675961746226.c804397231ed8faa5ea2759a18ad370d. started... 2023-02-09 16:55:47,350 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing d5ef12f1d65f6f85f477fbd699fd3cf9 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-09 16:55:47,350 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing c804397231ed8faa5ea2759a18ad370d 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-09 16:55:47,362 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230209b82305ec31664e9f8ab99add294e93b8 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230209b82305ec31664e9f8ab99add294e93b8 2023-02-09 16:55:47,362 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023020951b157020b6447b4bfaf3a94d4fc6c0f to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023020951b157020b6447b4bfaf3a94d4fc6c0f 2023-02-09 16:55:47,369 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/.tmp/family1/805a1e5e3a2f4ae69b7565a18c4be8ae 2023-02-09 16:55:47,382 DEBUG [RS:0;jenkins-hbase4:35511-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/.tmp/family1/7928d8cbfb1e4eb08f4dedbb6997c578 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1/7928d8cbfb1e4eb08f4dedbb6997c578 2023-02-09 16:55:47,387 INFO [RS:0;jenkins-hbase4:35511-longCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in 8f50653056db0fc97159c3a723710554/family1 of 8f50653056db0fc97159c3a723710554 into 7928d8cbfb1e4eb08f4dedbb6997c578(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-09 16:55:47,387 DEBUG [RS:0;jenkins-hbase4:35511-longCompactions-0] regionserver.HRegion(2288): Compaction status journal for 8f50653056db0fc97159c3a723710554: 2023-02-09 16:55:47,387 INFO [RS:0;jenkins-hbase4:35511-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,2,1675961720347.8f50653056db0fc97159c3a723710554., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1675961746056; duration=1sec 2023-02-09 16:55:47,388 DEBUG [RS:0;jenkins-hbase4:35511-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-02-09 16:55:47,388 DEBUG [RS:0;jenkins-hbase4:35511-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-02-09 16:55:47,390 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1/testCompactionWithHFileLink=8f50653056db0fc97159c3a723710554-9960ca25ee884e899d44d73e77321d91, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1/testCompactionWithHFileLink=8f50653056db0fc97159c3a723710554-bbd66b2a75854d769f68ec967526f8e4, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1/testCompactionWithHFileLink=8f50653056db0fc97159c3a723710554-95fe8fee4073477c8d575821319f6012, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1/testCompactionWithHFileLink=8f50653056db0fc97159c3a723710554-b5696cb1277d4b3f9d2aaf063efb7dbd, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1/c14786c1729f4e71812174e1a53cef93_SeqId_34_] to archive 2023-02-09 16:55:47,391 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 16:55:47,391 DEBUG [RS:0;jenkins-hbase4:35511-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-02-09 16:55:47,391 DEBUG [RS:0;jenkins-hbase4:35511-longCompactions-0] regionserver.HStore(1912): 8f50653056db0fc97159c3a723710554/family2 is initiating minor compaction (all files) 2023-02-09 16:55:47,391 INFO [RS:0;jenkins-hbase4:35511-longCompactions-0] regionserver.HRegion(2258): Starting compaction of 8f50653056db0fc97159c3a723710554/family2 in testCompactionWithHFileLink,2,1675961720347.8f50653056db0fc97159c3a723710554. 2023-02-09 16:55:47,391 INFO [RS:0;jenkins-hbase4:35511-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family2/testCompactionWithHFileLink=8f50653056db0fc97159c3a723710554-83269f5b6253457b801063cde566d9a5, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family2/testCompactionWithHFileLink=8f50653056db0fc97159c3a723710554-253a38900d1948339df6cb97b5c85255, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family2/testCompactionWithHFileLink=8f50653056db0fc97159c3a723710554-2b4aaa427870487695f27db022840756, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family2/testCompactionWithHFileLink=8f50653056db0fc97159c3a723710554-1c3a8a6e6ea44571b8fda362269e1731] into tmpdir=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/.tmp, totalSize=20.4 K 2023-02-09 16:55:47,392 DEBUG [RS:0;jenkins-hbase4:35511-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=8f50653056db0fc97159c3a723710554-83269f5b6253457b801063cde566d9a5, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675961722465 2023-02-09 16:55:47,392 DEBUG [RS:0;jenkins-hbase4:35511-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=8f50653056db0fc97159c3a723710554-253a38900d1948339df6cb97b5c85255, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675961723846 2023-02-09 16:55:47,393 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1/testCompactionWithHFileLink=8f50653056db0fc97159c3a723710554-9960ca25ee884e899d44d73e77321d91 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1/testCompactionWithHFileLink=8f50653056db0fc97159c3a723710554-9960ca25ee884e899d44d73e77321d91 2023-02-09 16:55:47,393 DEBUG [RS:0;jenkins-hbase4:35511-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=8f50653056db0fc97159c3a723710554-2b4aaa427870487695f27db022840756, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675961725624 2023-02-09 16:55:47,394 DEBUG [RS:0;jenkins-hbase4:35511-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=8f50653056db0fc97159c3a723710554-1c3a8a6e6ea44571b8fda362269e1731, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675961727415 2023-02-09 16:55:47,394 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1/testCompactionWithHFileLink=8f50653056db0fc97159c3a723710554-bbd66b2a75854d769f68ec967526f8e4 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1/testCompactionWithHFileLink=8f50653056db0fc97159c3a723710554-bbd66b2a75854d769f68ec967526f8e4 2023-02-09 16:55:47,396 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1/testCompactionWithHFileLink=8f50653056db0fc97159c3a723710554-95fe8fee4073477c8d575821319f6012 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1/testCompactionWithHFileLink=8f50653056db0fc97159c3a723710554-95fe8fee4073477c8d575821319f6012 2023-02-09 16:55:47,398 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1/testCompactionWithHFileLink=8f50653056db0fc97159c3a723710554-b5696cb1277d4b3f9d2aaf063efb7dbd to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1/testCompactionWithHFileLink=8f50653056db0fc97159c3a723710554-b5696cb1277d4b3f9d2aaf063efb7dbd 2023-02-09 16:55:47,399 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1/c14786c1729f4e71812174e1a53cef93_SeqId_34_ to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family1/c14786c1729f4e71812174e1a53cef93_SeqId_34_ 2023-02-09 16:55:47,408 INFO [RS:0;jenkins-hbase4:35511-longCompactions-0] throttle.PressureAwareThroughputController(145): 8f50653056db0fc97159c3a723710554#family2#compaction#123 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 16:55:47,762 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302090220106aa16c4e3cad3260cbe97dca16 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202302090220106aa16c4e3cad3260cbe97dca16 2023-02-09 16:55:47,769 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/.tmp/family1/8792351214754918ba629123a87a0533 2023-02-09 16:55:47,786 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302095099c0286fa24ba7828fab990e12a13a to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202302095099c0286fa24ba7828fab990e12a13a 2023-02-09 16:55:47,851 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/.tmp/family2/f50fea01ffca4320b51184da63642d49 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family2/f50fea01ffca4320b51184da63642d49 2023-02-09 16:55:47,854 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 964f5813343e8a443a0a9846e8b60a1a/family2 of 964f5813343e8a443a0a9846e8b60a1a into f50fea01ffca4320b51184da63642d49(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-09 16:55:47,854 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 964f5813343e8a443a0a9846e8b60a1a: 2023-02-09 16:55:47,854 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1675961720347.964f5813343e8a443a0a9846e8b60a1a., storeName=964f5813343e8a443a0a9846e8b60a1a/family2, priority=12, startTime=1675961744967; duration=1sec 2023-02-09 16:55:47,855 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-02-09 16:55:47,855 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-02-09 16:55:47,855 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-02-09 16:55:47,855 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-02-09 16:55:47,855 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,2,1675961720347.8f50653056db0fc97159c3a723710554. because compaction request was cancelled 2023-02-09 16:55:47,893 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family2/testCompactionWithHFileLink=964f5813343e8a443a0a9846e8b60a1a-6a91dabe164b468b8eb198799372a729, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family2/testCompactionWithHFileLink=964f5813343e8a443a0a9846e8b60a1a-61d7c5d467734196aaf47bb8a75ee866, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family2/testCompactionWithHFileLink=964f5813343e8a443a0a9846e8b60a1a-41872818fa124596bdceeb9e4d43509d, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family2/testCompactionWithHFileLink=964f5813343e8a443a0a9846e8b60a1a-6c223c6d2b8747279825b472ebbe3b88] to archive 2023-02-09 16:55:47,893 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 16:55:47,895 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family2/testCompactionWithHFileLink=964f5813343e8a443a0a9846e8b60a1a-6a91dabe164b468b8eb198799372a729 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family2/testCompactionWithHFileLink=964f5813343e8a443a0a9846e8b60a1a-6a91dabe164b468b8eb198799372a729 2023-02-09 16:55:47,896 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family2/testCompactionWithHFileLink=964f5813343e8a443a0a9846e8b60a1a-61d7c5d467734196aaf47bb8a75ee866 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family2/testCompactionWithHFileLink=964f5813343e8a443a0a9846e8b60a1a-61d7c5d467734196aaf47bb8a75ee866 2023-02-09 16:55:47,896 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family2/testCompactionWithHFileLink=964f5813343e8a443a0a9846e8b60a1a-41872818fa124596bdceeb9e4d43509d to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family2/testCompactionWithHFileLink=964f5813343e8a443a0a9846e8b60a1a-41872818fa124596bdceeb9e4d43509d 2023-02-09 16:55:47,897 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family2/testCompactionWithHFileLink=964f5813343e8a443a0a9846e8b60a1a-6c223c6d2b8747279825b472ebbe3b88 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/family2/testCompactionWithHFileLink=964f5813343e8a443a0a9846e8b60a1a-6c223c6d2b8747279825b472ebbe3b88 2023-02-09 16:55:48,167 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/.tmp/family1/7bbe76d4711e4e94a4458374f90ee9f4 2023-02-09 16:55:48,180 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302090eed15147e7544ddb31a69122897630f to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202302090eed15147e7544ddb31a69122897630f 2023-02-09 16:55:48,192 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/.tmp/family2/8adb2211f5c04aac9d935fd4d69022ad 2023-02-09 16:55:48,196 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/.tmp/family1/805a1e5e3a2f4ae69b7565a18c4be8ae as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/family1/805a1e5e3a2f4ae69b7565a18c4be8ae 2023-02-09 16:55:48,199 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/family1/805a1e5e3a2f4ae69b7565a18c4be8ae, entries=4, sequenceid=5, filesize=5.4 K 2023-02-09 16:55:48,199 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/.tmp/family2/8adb2211f5c04aac9d935fd4d69022ad as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/family2/8adb2211f5c04aac9d935fd4d69022ad 2023-02-09 16:55:48,202 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/family2/8adb2211f5c04aac9d935fd4d69022ad, entries=2, sequenceid=5, filesize=5.1 K 2023-02-09 16:55:48,203 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for d5ef12f1d65f6f85f477fbd699fd3cf9 in 853ms, sequenceid=5, compaction requested=false 2023-02-09 16:55:48,203 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'ns:testMinorCompaction' 2023-02-09 16:55:48,204 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for d5ef12f1d65f6f85f477fbd699fd3cf9: 2023-02-09 16:55:48,204 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1675961746226.d5ef12f1d65f6f85f477fbd699fd3cf9. 2023-02-09 16:55:48,204 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-09 16:55:48,580 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230209771d527efafd4814bf7296e13c9e6c76 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20230209771d527efafd4814bf7296e13c9e6c76 2023-02-09 16:55:48,584 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/.tmp/family2/077edc7a75874a83950312e3a77c0a68 2023-02-09 16:55:48,588 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/.tmp/family1/8792351214754918ba629123a87a0533 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/family1/8792351214754918ba629123a87a0533 2023-02-09 16:55:48,591 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/family1/8792351214754918ba629123a87a0533, entries=4, sequenceid=5, filesize=5.4 K 2023-02-09 16:55:48,592 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/.tmp/family2/077edc7a75874a83950312e3a77c0a68 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/family2/077edc7a75874a83950312e3a77c0a68 2023-02-09 16:55:48,595 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/family2/077edc7a75874a83950312e3a77c0a68, entries=2, sequenceid=5, filesize=5.1 K 2023-02-09 16:55:48,596 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for c804397231ed8faa5ea2759a18ad370d in 1246ms, sequenceid=5, compaction requested=false 2023-02-09 16:55:48,597 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for c804397231ed8faa5ea2759a18ad370d: 2023-02-09 16:55:48,597 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1675961746226.c804397231ed8faa5ea2759a18ad370d. 2023-02-09 16:55:48,597 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-09 16:55:48,624 DEBUG [RS:0;jenkins-hbase4:35511-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/.tmp/family2/a31aa4a83a3f443b8a29ca6e9673c47f as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family2/a31aa4a83a3f443b8a29ca6e9673c47f 2023-02-09 16:55:48,628 INFO [RS:0;jenkins-hbase4:35511-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 8f50653056db0fc97159c3a723710554/family2 of 8f50653056db0fc97159c3a723710554 into a31aa4a83a3f443b8a29ca6e9673c47f(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-09 16:55:48,628 DEBUG [RS:0;jenkins-hbase4:35511-longCompactions-0] regionserver.HRegion(2288): Compaction status journal for 8f50653056db0fc97159c3a723710554: 2023-02-09 16:55:48,628 INFO [RS:0;jenkins-hbase4:35511-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1675961720347.8f50653056db0fc97159c3a723710554., storeName=8f50653056db0fc97159c3a723710554/family2, priority=12, startTime=1675961745023; duration=1sec 2023-02-09 16:55:48,628 DEBUG [RS:0;jenkins-hbase4:35511-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 16:55:48,685 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family2/testCompactionWithHFileLink=8f50653056db0fc97159c3a723710554-83269f5b6253457b801063cde566d9a5, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family2/testCompactionWithHFileLink=8f50653056db0fc97159c3a723710554-253a38900d1948339df6cb97b5c85255, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family2/testCompactionWithHFileLink=8f50653056db0fc97159c3a723710554-2b4aaa427870487695f27db022840756, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family2/testCompactionWithHFileLink=8f50653056db0fc97159c3a723710554-1c3a8a6e6ea44571b8fda362269e1731] to archive 2023-02-09 16:55:48,686 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 16:55:48,688 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family2/testCompactionWithHFileLink=8f50653056db0fc97159c3a723710554-83269f5b6253457b801063cde566d9a5 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family2/testCompactionWithHFileLink=8f50653056db0fc97159c3a723710554-83269f5b6253457b801063cde566d9a5 2023-02-09 16:55:48,689 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family2/testCompactionWithHFileLink=8f50653056db0fc97159c3a723710554-253a38900d1948339df6cb97b5c85255 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family2/testCompactionWithHFileLink=8f50653056db0fc97159c3a723710554-253a38900d1948339df6cb97b5c85255 2023-02-09 16:55:48,690 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family2/testCompactionWithHFileLink=8f50653056db0fc97159c3a723710554-2b4aaa427870487695f27db022840756 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family2/testCompactionWithHFileLink=8f50653056db0fc97159c3a723710554-2b4aaa427870487695f27db022840756 2023-02-09 16:55:48,691 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family2/testCompactionWithHFileLink=8f50653056db0fc97159c3a723710554-1c3a8a6e6ea44571b8fda362269e1731 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/family2/testCompactionWithHFileLink=8f50653056db0fc97159c3a723710554-1c3a8a6e6ea44571b8fda362269e1731 2023-02-09 16:55:48,985 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/.tmp/family2/82a5cf0a6b6b40a5a4cac108cf2d4b54 2023-02-09 16:55:48,989 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/.tmp/family1/7bbe76d4711e4e94a4458374f90ee9f4 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/family1/7bbe76d4711e4e94a4458374f90ee9f4 2023-02-09 16:55:48,993 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/family1/7bbe76d4711e4e94a4458374f90ee9f4, entries=4, sequenceid=5, filesize=5.4 K 2023-02-09 16:55:48,994 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/.tmp/family2/82a5cf0a6b6b40a5a4cac108cf2d4b54 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/family2/82a5cf0a6b6b40a5a4cac108cf2d4b54 2023-02-09 16:55:48,997 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/family2/82a5cf0a6b6b40a5a4cac108cf2d4b54, entries=2, sequenceid=5, filesize=5.1 K 2023-02-09 16:55:48,998 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 89b5638a4d4b48414e2d99d1dafde008 in 1648ms, sequenceid=5, compaction requested=false 2023-02-09 16:55:48,998 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 89b5638a4d4b48414e2d99d1dafde008: 2023-02-09 16:55:48,999 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1675961746226.89b5638a4d4b48414e2d99d1dafde008. 2023-02-09 16:55:48,999 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-09 16:55:48,999 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-09 16:55:48,999 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:48,999 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-02-09 16:55:48,999 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-02-09 16:55:49,000 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:49,000 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 16:55:49,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:49,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:55:49,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:55:49,001 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 16:55:49,001 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:55:49,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:55:49,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:55:49,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 16:55:49,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:49,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:55:49,003 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-02-09 16:55:49,003 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6dd4c54a[Count = 0] remaining members to acquire global barrier 2023-02-09 16:55:49,003 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-02-09 16:55:49,003 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 16:55:49,004 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 16:55:49,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 16:55:49,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 16:55:49,004 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-02-09 16:55:49,004 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-02-09 16:55:49,004 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:55:49,004 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:49,004 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:55:49,006 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-02-09 16:55:49,007 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:55:49,006 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:49,007 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-02-09 16:55:49,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:49,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:55:49,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:55:49,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:55:49,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:55:49,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 16:55:49,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:49,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:55:49,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 16:55:49,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:49,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:55:49,009 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-02-09 16:55:49,009 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-02-09 16:55:49,009 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:55:49,009 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:55:49,009 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-02-09 16:55:49,009 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:55:49,011 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 16:55:49,011 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 16:55:49,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 16:55:49,011 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 16:55:49,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:55:49,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:55:49,011 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:55:49,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 16:55:49,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:55:49,012 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:55:49,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:55:49,012 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:49,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 16:55:49,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 16:55:49,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:55:49,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 16:55:49,013 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:49,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:49,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:55:49,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 16:55:49,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:49,015 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:49,015 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:55:49,015 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-09 16:55:49,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:55:49,015 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-09 16:55:49,015 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:49,015 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 16:55:49,015 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 16:55:49,016 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 16:55:49,015 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:55:49,016 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-02-09 16:55:49,016 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:55:49,016 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:55:49,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:55:49,016 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-02-09 16:55:49,016 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-02-09 16:55:49,016 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:55:49,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:55:49,016 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:55:49,116 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:55:49,117 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:49,117 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:49,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:55:49,118 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,,1675961746226.89b5638a4d4b48414e2d99d1dafde008. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 16:55:49,119 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,1,1675961746226.d5ef12f1d65f6f85f477fbd699fd3cf9. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 16:55:49,119 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,2,1675961746226.c804397231ed8faa5ea2759a18ad370d. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 16:55:49,120 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:49,121 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:49,121 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:55:49,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-02-09 16:55:49,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-02-09 16:55:49,123 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-02-09 16:55:49,123 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:55:49,123 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-02-09 16:55:49,123 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-02-09 16:55:49,123 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 16:55:49,123 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-09 16:55:49,125 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:55:49,125 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:49,125 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:55:49,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:55:49,125 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:49,125 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:55:49,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-09 16:55:49,126 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 16:55:49,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:55:49,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-09 16:55:49,126 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-02-09 16:55:49,126 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-02-09 16:55:49,126 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-02-09 16:55:49,126 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-02-09 16:55:49,126 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:55:49,127 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-02-09 16:55:49,127 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1675961746226.89b5638a4d4b48414e2d99d1dafde008. 2023-02-09 16:55:49,127 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1675961746226.c804397231ed8faa5ea2759a18ad370d. 2023-02-09 16:55:49,127 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1675961746226.c804397231ed8faa5ea2759a18ad370d. started... 2023-02-09 16:55:49,127 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1675961746226.89b5638a4d4b48414e2d99d1dafde008. started... 2023-02-09 16:55:49,127 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-09 16:55:49,127 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing c804397231ed8faa5ea2759a18ad370d 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-09 16:55:49,127 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 89b5638a4d4b48414e2d99d1dafde008 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-09 16:55:49,127 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1675961746226.d5ef12f1d65f6f85f477fbd699fd3cf9. 2023-02-09 16:55:49,127 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:55:49,127 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1675961746226.d5ef12f1d65f6f85f477fbd699fd3cf9. started... 2023-02-09 16:55:49,127 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing d5ef12f1d65f6f85f477fbd699fd3cf9 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-09 16:55:49,141 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230209888b3edad64145b8bd920cc28e3ee77c to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230209888b3edad64145b8bd920cc28e3ee77c 2023-02-09 16:55:49,538 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023020923068f27f1f4488b8a5e71ff25de6aa1 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023020923068f27f1f4488b8a5e71ff25de6aa1 2023-02-09 16:55:49,539 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230209b8aa932f685743ef9ec02f1478aa560c to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230209b8aa932f685743ef9ec02f1478aa560c 2023-02-09 16:55:49,546 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/.tmp/family1/f372430d438248bf80220cf9d9eb35bb 2023-02-09 16:55:49,943 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/.tmp/family1/ca923ea3810f4e29ae16a060996e75c5 2023-02-09 16:55:49,944 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/.tmp/family1/db08c206636d4f8594a9d88a9fae904b 2023-02-09 16:55:49,958 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023020918229afec73e43868122d25df103ea91 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b2023020918229afec73e43868122d25df103ea91 2023-02-09 16:55:50,358 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302096fe82e7eca10445ba730094be538a80a to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202302096fe82e7eca10445ba730094be538a80a 2023-02-09 16:55:50,359 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230209a90a37834cf34cbea4751949c3aa6fd4 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20230209a90a37834cf34cbea4751949c3aa6fd4 2023-02-09 16:55:50,366 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/.tmp/family2/7b0c1990d5f344b88c25d55afbd4a8cf 2023-02-09 16:55:50,369 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/.tmp/family1/f372430d438248bf80220cf9d9eb35bb as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/family1/f372430d438248bf80220cf9d9eb35bb 2023-02-09 16:55:50,373 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/family1/f372430d438248bf80220cf9d9eb35bb, entries=4, sequenceid=9, filesize=5.4 K 2023-02-09 16:55:50,373 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/.tmp/family2/7b0c1990d5f344b88c25d55afbd4a8cf as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/family2/7b0c1990d5f344b88c25d55afbd4a8cf 2023-02-09 16:55:50,377 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/family2/7b0c1990d5f344b88c25d55afbd4a8cf, entries=2, sequenceid=9, filesize=5.1 K 2023-02-09 16:55:50,378 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for d5ef12f1d65f6f85f477fbd699fd3cf9 in 1251ms, sequenceid=9, compaction requested=false 2023-02-09 16:55:50,378 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for d5ef12f1d65f6f85f477fbd699fd3cf9: 2023-02-09 16:55:50,378 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1675961746226.d5ef12f1d65f6f85f477fbd699fd3cf9. 2023-02-09 16:55:50,378 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-09 16:55:50,764 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/.tmp/family2/a7797c4f95d84753b216e413e46c12c8 2023-02-09 16:55:50,764 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/.tmp/family2/fafc06d46b844d60a09947ddc06b961b 2023-02-09 16:55:50,768 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/.tmp/family1/ca923ea3810f4e29ae16a060996e75c5 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/family1/ca923ea3810f4e29ae16a060996e75c5 2023-02-09 16:55:50,768 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/.tmp/family1/db08c206636d4f8594a9d88a9fae904b as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/family1/db08c206636d4f8594a9d88a9fae904b 2023-02-09 16:55:50,771 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/family1/ca923ea3810f4e29ae16a060996e75c5, entries=4, sequenceid=9, filesize=5.4 K 2023-02-09 16:55:50,772 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/family1/db08c206636d4f8594a9d88a9fae904b, entries=4, sequenceid=9, filesize=5.4 K 2023-02-09 16:55:50,772 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/.tmp/family2/a7797c4f95d84753b216e413e46c12c8 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/family2/a7797c4f95d84753b216e413e46c12c8 2023-02-09 16:55:50,773 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/.tmp/family2/fafc06d46b844d60a09947ddc06b961b as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/family2/fafc06d46b844d60a09947ddc06b961b 2023-02-09 16:55:50,775 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/family2/a7797c4f95d84753b216e413e46c12c8, entries=2, sequenceid=9, filesize=5.1 K 2023-02-09 16:55:50,776 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 89b5638a4d4b48414e2d99d1dafde008 in 1649ms, sequenceid=9, compaction requested=false 2023-02-09 16:55:50,776 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 89b5638a4d4b48414e2d99d1dafde008: 2023-02-09 16:55:50,776 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1675961746226.89b5638a4d4b48414e2d99d1dafde008. 2023-02-09 16:55:50,776 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/family2/fafc06d46b844d60a09947ddc06b961b, entries=2, sequenceid=9, filesize=5.1 K 2023-02-09 16:55:50,776 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-09 16:55:50,777 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for c804397231ed8faa5ea2759a18ad370d in 1650ms, sequenceid=9, compaction requested=false 2023-02-09 16:55:50,777 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for c804397231ed8faa5ea2759a18ad370d: 2023-02-09 16:55:50,777 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1675961746226.c804397231ed8faa5ea2759a18ad370d. 2023-02-09 16:55:50,777 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-09 16:55:50,777 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-09 16:55:50,777 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:50,777 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-02-09 16:55:50,777 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-02-09 16:55:50,778 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 16:55:50,778 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:50,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:50,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:55:50,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:55:50,779 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 16:55:50,779 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:55:50,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:55:50,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:55:50,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 16:55:50,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:50,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:55:50,781 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-02-09 16:55:50,781 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@54c315bf[Count = 0] remaining members to acquire global barrier 2023-02-09 16:55:50,781 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-02-09 16:55:50,781 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 16:55:50,783 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 16:55:50,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 16:55:50,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 16:55:50,784 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-02-09 16:55:50,784 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-02-09 16:55:50,784 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:50,784 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:55:50,784 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:55:50,788 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:50,788 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-02-09 16:55:50,788 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:55:50,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:50,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:55:50,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:55:50,788 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-02-09 16:55:50,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:55:50,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:55:50,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 16:55:50,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:50,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:55:50,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 16:55:50,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:50,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:55:50,790 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-02-09 16:55:50,790 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-02-09 16:55:50,790 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:55:50,790 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:55:50,790 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-02-09 16:55:50,790 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:55:50,792 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 16:55:50,792 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 16:55:50,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 16:55:50,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:55:50,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:55:50,792 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 16:55:50,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 16:55:50,792 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:55:50,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:55:50,793 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:55:50,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:55:50,793 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:50,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 16:55:50,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 16:55:50,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:55:50,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 16:55:50,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:50,794 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:50,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:55:50,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 16:55:50,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:50,797 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:50,797 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:55:50,797 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-09 16:55:50,797 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:55:50,797 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-09 16:55:50,797 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-02-09 16:55:50,798 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:55:50,797 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:55:50,798 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:50,797 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:55:50,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:55:50,798 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 16:55:50,798 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 16:55:50,798 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 16:55:50,798 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-02-09 16:55:50,798 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:55:50,798 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:55:50,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:55:50,898 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:55:50,898 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:50,898 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:50,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:55:50,900 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,,1675961746226.89b5638a4d4b48414e2d99d1dafde008. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 16:55:50,900 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,1,1675961746226.d5ef12f1d65f6f85f477fbd699fd3cf9. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 16:55:50,901 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,2,1675961746226.c804397231ed8faa5ea2759a18ad370d. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 16:55:50,902 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:50,902 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:50,903 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:55:50,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-02-09 16:55:50,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-02-09 16:55:50,904 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-02-09 16:55:50,904 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:55:50,904 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-02-09 16:55:50,904 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-02-09 16:55:50,905 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 16:55:50,905 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-09 16:55:50,906 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:55:50,906 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:50,906 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:55:50,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:55:50,906 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:50,906 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:55:50,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-09 16:55:50,907 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 16:55:50,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:55:50,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-09 16:55:50,907 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-02-09 16:55:50,907 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-02-09 16:55:50,907 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-02-09 16:55:50,907 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-02-09 16:55:50,907 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:55:50,907 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-02-09 16:55:50,908 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1675961746226.89b5638a4d4b48414e2d99d1dafde008. 2023-02-09 16:55:50,908 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1675961746226.89b5638a4d4b48414e2d99d1dafde008. started... 2023-02-09 16:55:50,908 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1675961746226.c804397231ed8faa5ea2759a18ad370d. 2023-02-09 16:55:50,908 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1675961746226.c804397231ed8faa5ea2759a18ad370d. started... 2023-02-09 16:55:50,908 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-09 16:55:50,908 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:55:50,908 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1675961746226.d5ef12f1d65f6f85f477fbd699fd3cf9. 2023-02-09 16:55:50,908 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1675961746226.d5ef12f1d65f6f85f477fbd699fd3cf9. started... 2023-02-09 16:55:50,908 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 89b5638a4d4b48414e2d99d1dafde008 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-09 16:55:50,908 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing c804397231ed8faa5ea2759a18ad370d 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-09 16:55:50,908 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing d5ef12f1d65f6f85f477fbd699fd3cf9 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-09 16:55:51,323 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230209632417bc863c46abbceb477fa933065c to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230209632417bc863c46abbceb477fa933065c 2023-02-09 16:55:51,323 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023020915936587c5a644f1b7478212a9501b71 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023020915936587c5a644f1b7478212a9501b71 2023-02-09 16:55:51,324 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230209dd0ef03dc461418995baab11d43bd632 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230209dd0ef03dc461418995baab11d43bd632 2023-02-09 16:55:51,729 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/.tmp/family1/e2658d34d3e742feab444f32b3328e14 2023-02-09 16:55:51,729 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/.tmp/family1/b6d0db7b6e854b979dd4bc2562d8f1a9 2023-02-09 16:55:51,729 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/.tmp/family1/a576784d0da2417f89b873bd3e7e144c 2023-02-09 16:55:52,143 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230209ae71bba7d5634e57aa7d885736099ec2 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20230209ae71bba7d5634e57aa7d885736099ec2 2023-02-09 16:55:52,143 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302092e376ad57c2c4fb7ac97db6fa0e2af69 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202302092e376ad57c2c4fb7ac97db6fa0e2af69 2023-02-09 16:55:52,143 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023020966db56432ff746a3b0539147d372ab7f to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b2023020966db56432ff746a3b0539147d372ab7f 2023-02-09 16:55:52,481 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-09 16:55:52,548 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/.tmp/family2/9ae43199092f4f1aba75980d8e0cd096 2023-02-09 16:55:52,552 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/.tmp/family1/e2658d34d3e742feab444f32b3328e14 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/family1/e2658d34d3e742feab444f32b3328e14 2023-02-09 16:55:52,555 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/.tmp/family2/dbf613606dff4602a7992bbdf0ea0253 2023-02-09 16:55:52,555 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/.tmp/family2/c5aae8deaf734d6bad835c1e6c296062 2023-02-09 16:55:52,556 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/family1/e2658d34d3e742feab444f32b3328e14, entries=4, sequenceid=13, filesize=5.4 K 2023-02-09 16:55:52,557 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/.tmp/family2/9ae43199092f4f1aba75980d8e0cd096 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/family2/9ae43199092f4f1aba75980d8e0cd096 2023-02-09 16:55:52,559 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/.tmp/family1/b6d0db7b6e854b979dd4bc2562d8f1a9 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/family1/b6d0db7b6e854b979dd4bc2562d8f1a9 2023-02-09 16:55:52,559 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/.tmp/family1/a576784d0da2417f89b873bd3e7e144c as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/family1/a576784d0da2417f89b873bd3e7e144c 2023-02-09 16:55:52,560 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/family2/9ae43199092f4f1aba75980d8e0cd096, entries=2, sequenceid=13, filesize=5.1 K 2023-02-09 16:55:52,561 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for c804397231ed8faa5ea2759a18ad370d in 1653ms, sequenceid=13, compaction requested=true 2023-02-09 16:55:52,561 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for c804397231ed8faa5ea2759a18ad370d: 2023-02-09 16:55:52,561 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1675961746226.c804397231ed8faa5ea2759a18ad370d. 2023-02-09 16:55:52,561 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-09 16:55:52,563 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/family1/b6d0db7b6e854b979dd4bc2562d8f1a9, entries=4, sequenceid=13, filesize=5.4 K 2023-02-09 16:55:52,563 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/family1/a576784d0da2417f89b873bd3e7e144c, entries=4, sequenceid=13, filesize=5.4 K 2023-02-09 16:55:52,563 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/.tmp/family2/dbf613606dff4602a7992bbdf0ea0253 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/family2/dbf613606dff4602a7992bbdf0ea0253 2023-02-09 16:55:52,563 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/.tmp/family2/c5aae8deaf734d6bad835c1e6c296062 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/family2/c5aae8deaf734d6bad835c1e6c296062 2023-02-09 16:55:52,567 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/family2/dbf613606dff4602a7992bbdf0ea0253, entries=2, sequenceid=13, filesize=5.1 K 2023-02-09 16:55:52,567 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/family2/c5aae8deaf734d6bad835c1e6c296062, entries=2, sequenceid=13, filesize=5.1 K 2023-02-09 16:55:52,568 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 89b5638a4d4b48414e2d99d1dafde008 in 1660ms, sequenceid=13, compaction requested=true 2023-02-09 16:55:52,568 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for d5ef12f1d65f6f85f477fbd699fd3cf9 in 1660ms, sequenceid=13, compaction requested=true 2023-02-09 16:55:52,568 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 89b5638a4d4b48414e2d99d1dafde008: 2023-02-09 16:55:52,568 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for d5ef12f1d65f6f85f477fbd699fd3cf9: 2023-02-09 16:55:52,568 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1675961746226.d5ef12f1d65f6f85f477fbd699fd3cf9. 2023-02-09 16:55:52,568 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1675961746226.89b5638a4d4b48414e2d99d1dafde008. 2023-02-09 16:55:52,568 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-09 16:55:52,568 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-09 16:55:52,568 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-09 16:55:52,568 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:52,568 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-02-09 16:55:52,568 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-02-09 16:55:52,569 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 16:55:52,569 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:52,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:52,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:55:52,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:55:52,570 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 16:55:52,570 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:55:52,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:55:52,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:55:52,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 16:55:52,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:52,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:55:52,571 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-02-09 16:55:52,571 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1f7674f8[Count = 0] remaining members to acquire global barrier 2023-02-09 16:55:52,571 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-02-09 16:55:52,571 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 16:55:52,572 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 16:55:52,572 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 16:55:52,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 16:55:52,572 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-02-09 16:55:52,572 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-02-09 16:55:52,572 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:55:52,572 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:52,572 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:55:52,573 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-02-09 16:55:52,573 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:52,573 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:55:52,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:52,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:55:52,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:55:52,574 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-02-09 16:55:52,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:55:52,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:55:52,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 16:55:52,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:52,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:55:52,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 16:55:52,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:52,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:55:52,576 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-02-09 16:55:52,576 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-02-09 16:55:52,576 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:55:52,576 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:55:52,576 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-02-09 16:55:52,576 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:55:52,578 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 16:55:52,578 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 16:55:52,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 16:55:52,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:55:52,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:55:52,578 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 16:55:52,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 16:55:52,578 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:55:52,578 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:55:52,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:55:52,579 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:52,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:55:52,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 16:55:52,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 16:55:52,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:55:52,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 16:55:52,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:52,580 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:52,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:55:52,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 16:55:52,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:52,582 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:52,582 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:55:52,582 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-09 16:55:52,582 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:55:52,582 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-02-09 16:55:52,582 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:55:52,582 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:55:52,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:55:52,582 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:55:52,582 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-09 16:55:52,582 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:52,582 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 16:55:52,582 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 16:55:52,582 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-02-09 16:55:52,582 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:55:52,582 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 16:55:52,582 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:55:52,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:55:52,682 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:55:52,683 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:52,683 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:52,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:55:52,684 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,,1675961746226.89b5638a4d4b48414e2d99d1dafde008. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 16:55:52,685 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,1,1675961746226.d5ef12f1d65f6f85f477fbd699fd3cf9. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 16:55:52,685 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,2,1675961746226.c804397231ed8faa5ea2759a18ad370d. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 16:55:52,687 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:52,688 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:52,688 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:55:52,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-02-09 16:55:52,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-02-09 16:55:52,692 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-02-09 16:55:52,692 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:55:52,692 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-02-09 16:55:52,692 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-02-09 16:55:52,693 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 16:55:52,693 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-09 16:55:52,694 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:52,694 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:55:52,694 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:55:52,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:55:52,694 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:52,694 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:55:52,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-09 16:55:52,695 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 16:55:52,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:55:52,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-09 16:55:52,695 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-02-09 16:55:52,696 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-02-09 16:55:52,696 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-02-09 16:55:52,696 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-02-09 16:55:52,696 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:55:52,696 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-02-09 16:55:52,696 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1675961746226.89b5638a4d4b48414e2d99d1dafde008. 2023-02-09 16:55:52,696 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1675961746226.89b5638a4d4b48414e2d99d1dafde008. started... 2023-02-09 16:55:52,697 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 89b5638a4d4b48414e2d99d1dafde008 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-09 16:55:52,698 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1675961746226.c804397231ed8faa5ea2759a18ad370d. 2023-02-09 16:55:52,698 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-09 16:55:52,698 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1675961746226.d5ef12f1d65f6f85f477fbd699fd3cf9. 2023-02-09 16:55:52,698 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1675961746226.d5ef12f1d65f6f85f477fbd699fd3cf9. started... 2023-02-09 16:55:52,698 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:55:52,698 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1675961746226.c804397231ed8faa5ea2759a18ad370d. started... 2023-02-09 16:55:52,698 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing d5ef12f1d65f6f85f477fbd699fd3cf9 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-09 16:55:52,698 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing c804397231ed8faa5ea2759a18ad370d 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-09 16:55:52,729 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302094f56fdea8d6a49e781faca1eb76ca421 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202302094f56fdea8d6a49e781faca1eb76ca421 2023-02-09 16:55:52,730 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302096b3328d3d32e4926b5bf47681206f4f2 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202302096b3328d3d32e4926b5bf47681206f4f2 2023-02-09 16:55:52,731 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302097d6cf68ab1334d599e89b44b94c53abe to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202302097d6cf68ab1334d599e89b44b94c53abe 2023-02-09 16:55:52,738 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/.tmp/family1/5518a41eada243ec87236a067bab81da 2023-02-09 16:55:52,738 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/.tmp/family1/7977a7804a0a47fca53e5396d7bbe2d8 2023-02-09 16:55:53,139 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/.tmp/family1/5802c5017e1b42a5af6e0e48df395026 2023-02-09 16:55:53,154 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230209e91a0bac9ba94fb6a395c74d5f01f808 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20230209e91a0bac9ba94fb6a395c74d5f01f808 2023-02-09 16:55:53,155 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230209d4e1306f6e594e74bfaf7170a94edcb2 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20230209d4e1306f6e594e74bfaf7170a94edcb2 2023-02-09 16:55:53,552 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302095a871ae340a04c20b9cfb16f45e347d0 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202302095a871ae340a04c20b9cfb16f45e347d0 2023-02-09 16:55:53,558 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/.tmp/family2/38a4421bb2c34621b39cd5a428b2f209 2023-02-09 16:55:53,559 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/.tmp/family2/93d2cc4c8b484c69b02702c4f9bf0c3f 2023-02-09 16:55:53,562 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/.tmp/family1/7977a7804a0a47fca53e5396d7bbe2d8 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/family1/7977a7804a0a47fca53e5396d7bbe2d8 2023-02-09 16:55:53,563 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/.tmp/family1/5518a41eada243ec87236a067bab81da as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/family1/5518a41eada243ec87236a067bab81da 2023-02-09 16:55:53,566 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/family1/7977a7804a0a47fca53e5396d7bbe2d8, entries=4, sequenceid=17, filesize=5.4 K 2023-02-09 16:55:53,566 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/family1/5518a41eada243ec87236a067bab81da, entries=4, sequenceid=17, filesize=5.4 K 2023-02-09 16:55:53,566 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/.tmp/family2/38a4421bb2c34621b39cd5a428b2f209 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/family2/38a4421bb2c34621b39cd5a428b2f209 2023-02-09 16:55:53,566 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/.tmp/family2/93d2cc4c8b484c69b02702c4f9bf0c3f as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/family2/93d2cc4c8b484c69b02702c4f9bf0c3f 2023-02-09 16:55:53,569 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/family2/38a4421bb2c34621b39cd5a428b2f209, entries=2, sequenceid=17, filesize=5.1 K 2023-02-09 16:55:53,570 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/family2/93d2cc4c8b484c69b02702c4f9bf0c3f, entries=2, sequenceid=17, filesize=5.1 K 2023-02-09 16:55:53,570 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for d5ef12f1d65f6f85f477fbd699fd3cf9 in 872ms, sequenceid=17, compaction requested=true 2023-02-09 16:55:53,570 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for d5ef12f1d65f6f85f477fbd699fd3cf9: 2023-02-09 16:55:53,570 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1675961746226.d5ef12f1d65f6f85f477fbd699fd3cf9. 2023-02-09 16:55:53,570 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-09 16:55:53,571 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 89b5638a4d4b48414e2d99d1dafde008 in 874ms, sequenceid=17, compaction requested=true 2023-02-09 16:55:53,571 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 89b5638a4d4b48414e2d99d1dafde008: 2023-02-09 16:55:53,571 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1675961746226.89b5638a4d4b48414e2d99d1dafde008. 2023-02-09 16:55:53,571 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-09 16:55:53,957 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/.tmp/family2/bf24362186234f0b980413a20777d6d2 2023-02-09 16:55:53,961 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/.tmp/family1/5802c5017e1b42a5af6e0e48df395026 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/family1/5802c5017e1b42a5af6e0e48df395026 2023-02-09 16:55:53,964 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/family1/5802c5017e1b42a5af6e0e48df395026, entries=4, sequenceid=17, filesize=5.4 K 2023-02-09 16:55:53,965 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/.tmp/family2/bf24362186234f0b980413a20777d6d2 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/family2/bf24362186234f0b980413a20777d6d2 2023-02-09 16:55:53,968 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/family2/bf24362186234f0b980413a20777d6d2, entries=2, sequenceid=17, filesize=5.1 K 2023-02-09 16:55:53,969 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for c804397231ed8faa5ea2759a18ad370d in 1271ms, sequenceid=17, compaction requested=true 2023-02-09 16:55:53,969 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for c804397231ed8faa5ea2759a18ad370d: 2023-02-09 16:55:53,969 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1675961746226.c804397231ed8faa5ea2759a18ad370d. 2023-02-09 16:55:53,969 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-09 16:55:53,969 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-09 16:55:53,969 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:53,969 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-02-09 16:55:53,969 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-02-09 16:55:53,970 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 16:55:53,971 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:53,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:53,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:55:53,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:55:53,971 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 16:55:53,971 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:55:53,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:55:53,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:55:53,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 16:55:53,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:53,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:55:53,972 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-02-09 16:55:53,972 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@60ea83db[Count = 0] remaining members to acquire global barrier 2023-02-09 16:55:53,972 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-02-09 16:55:53,972 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 16:55:53,975 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 16:55:53,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 16:55:53,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 16:55:53,975 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-02-09 16:55:53,975 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-02-09 16:55:53,975 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:55:53,975 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:53,975 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:55:53,976 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:53,976 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-02-09 16:55:53,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:53,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:55:53,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:55:53,976 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:55:53,977 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-02-09 16:55:53,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:55:53,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:55:53,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 16:55:53,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:53,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:55:53,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 16:55:53,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:53,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:55:53,981 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-02-09 16:55:53,981 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-02-09 16:55:53,982 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:55:53,982 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:55:53,982 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-02-09 16:55:53,982 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:55:53,983 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 16:55:53,983 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 16:55:53,983 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:55:53,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 16:55:53,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 16:55:53,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:55:53,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:55:53,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 16:55:53,984 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:55:53,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:55:53,984 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:53,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:55:53,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 16:55:53,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 16:55:53,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:55:53,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 16:55:53,985 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:53,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:53,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:55:53,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 16:55:53,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:53,988 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:55:53,988 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:53,988 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:55:53,988 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:55:53,988 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-02-09 16:55:53,988 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:55:53,988 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:55:53,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:55:53,988 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-09 16:55:53,988 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-02-09 16:55:53,988 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-09 16:55:53,988 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-02-09 16:55:53,988 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:55:53,988 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:53,988 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:55:53,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:55:53,988 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 16:55:53,989 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 16:55:53,989 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 16:55:54,089 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:55:54,089 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:54,089 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:54,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:55:54,097 DEBUG [Listener at localhost/41619] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-09 16:55:54,104 DEBUG [Listener at localhost/41619] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-09 16:55:54,112 DEBUG [Listener at localhost/41619] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-09 16:55:54,113 DEBUG [Listener at localhost/41619] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-09 16:55:54,136 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:54,136 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:54,137 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:55:54,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-02-09 16:55:54,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-02-09 16:55:54,138 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-02-09 16:55:54,138 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:55:54,138 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-02-09 16:55:54,138 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-02-09 16:55:54,139 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 16:55:54,139 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-09 16:55:54,141 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:55:54,141 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:54,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:55:54,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:55:54,142 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:54,142 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:55:54,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-09 16:55:54,142 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 16:55:54,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:55:54,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-09 16:55:54,142 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-02-09 16:55:54,142 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-02-09 16:55:54,142 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-02-09 16:55:54,142 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-02-09 16:55:54,143 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:55:54,143 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-02-09 16:55:54,143 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1675961746226.89b5638a4d4b48414e2d99d1dafde008. 2023-02-09 16:55:54,143 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1675961746226.89b5638a4d4b48414e2d99d1dafde008. started... 2023-02-09 16:55:54,143 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-09 16:55:54,143 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:55:54,143 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 89b5638a4d4b48414e2d99d1dafde008 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-09 16:55:54,143 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1675961746226.c804397231ed8faa5ea2759a18ad370d. 2023-02-09 16:55:54,143 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1675961746226.d5ef12f1d65f6f85f477fbd699fd3cf9. 2023-02-09 16:55:54,143 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1675961746226.c804397231ed8faa5ea2759a18ad370d. started... 2023-02-09 16:55:54,143 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1675961746226.d5ef12f1d65f6f85f477fbd699fd3cf9. started... 2023-02-09 16:55:54,143 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing c804397231ed8faa5ea2759a18ad370d 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-09 16:55:54,143 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing d5ef12f1d65f6f85f477fbd699fd3cf9 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-09 16:55:54,965 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/.tmp/family1/fae1c04bfb3b4167800ef998b21ecddf 2023-02-09 16:55:54,965 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/.tmp/family1/dfff5da4450b427e812052c8a21e67ab 2023-02-09 16:55:54,965 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/.tmp/family1/4af9e73ea7b94afd987d8b561154ee3e 2023-02-09 16:55:54,969 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fae1c04bfb3b4167800ef998b21ecddf 2023-02-09 16:55:54,969 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4af9e73ea7b94afd987d8b561154ee3e 2023-02-09 16:55:54,969 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dfff5da4450b427e812052c8a21e67ab 2023-02-09 16:55:55,391 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/.tmp/family2/5ffe70704ff94d28ae4929d76597f1b7 2023-02-09 16:55:55,395 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5ffe70704ff94d28ae4929d76597f1b7 2023-02-09 16:55:55,395 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/.tmp/family1/dfff5da4450b427e812052c8a21e67ab as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/family1/dfff5da4450b427e812052c8a21e67ab 2023-02-09 16:55:55,399 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dfff5da4450b427e812052c8a21e67ab 2023-02-09 16:55:55,399 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/family1/dfff5da4450b427e812052c8a21e67ab, entries=3, sequenceid=23, filesize=5.0 K 2023-02-09 16:55:55,400 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/.tmp/family2/5ffe70704ff94d28ae4929d76597f1b7 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/family2/5ffe70704ff94d28ae4929d76597f1b7 2023-02-09 16:55:55,406 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5ffe70704ff94d28ae4929d76597f1b7 2023-02-09 16:55:55,406 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/family2/5ffe70704ff94d28ae4929d76597f1b7, entries=1, sequenceid=23, filesize=5.0 K 2023-02-09 16:55:55,407 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for c804397231ed8faa5ea2759a18ad370d in 1264ms, sequenceid=23, compaction requested=true 2023-02-09 16:55:55,407 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for c804397231ed8faa5ea2759a18ad370d: 2023-02-09 16:55:55,407 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1675961746226.c804397231ed8faa5ea2759a18ad370d. 2023-02-09 16:55:55,407 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-09 16:55:55,791 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/.tmp/family2/42dc85c72b2e45bc87327a0332550f7f 2023-02-09 16:55:55,792 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/.tmp/family2/ab1827ed1ef640a3ae2c2342362f8b43 2023-02-09 16:55:55,795 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 42dc85c72b2e45bc87327a0332550f7f 2023-02-09 16:55:55,795 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ab1827ed1ef640a3ae2c2342362f8b43 2023-02-09 16:55:55,796 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/.tmp/family1/4af9e73ea7b94afd987d8b561154ee3e as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/family1/4af9e73ea7b94afd987d8b561154ee3e 2023-02-09 16:55:55,796 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/.tmp/family1/fae1c04bfb3b4167800ef998b21ecddf as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/family1/fae1c04bfb3b4167800ef998b21ecddf 2023-02-09 16:55:55,799 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4af9e73ea7b94afd987d8b561154ee3e 2023-02-09 16:55:55,799 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fae1c04bfb3b4167800ef998b21ecddf 2023-02-09 16:55:55,799 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/family1/4af9e73ea7b94afd987d8b561154ee3e, entries=3, sequenceid=23, filesize=5.0 K 2023-02-09 16:55:55,799 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/family1/fae1c04bfb3b4167800ef998b21ecddf, entries=3, sequenceid=23, filesize=5.0 K 2023-02-09 16:55:55,800 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/.tmp/family2/ab1827ed1ef640a3ae2c2342362f8b43 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/family2/ab1827ed1ef640a3ae2c2342362f8b43 2023-02-09 16:55:55,800 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/.tmp/family2/42dc85c72b2e45bc87327a0332550f7f as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/family2/42dc85c72b2e45bc87327a0332550f7f 2023-02-09 16:55:55,803 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ab1827ed1ef640a3ae2c2342362f8b43 2023-02-09 16:55:55,804 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/family2/ab1827ed1ef640a3ae2c2342362f8b43, entries=1, sequenceid=23, filesize=5.0 K 2023-02-09 16:55:55,804 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 42dc85c72b2e45bc87327a0332550f7f 2023-02-09 16:55:55,804 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/family2/42dc85c72b2e45bc87327a0332550f7f, entries=1, sequenceid=23, filesize=5.0 K 2023-02-09 16:55:55,804 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 89b5638a4d4b48414e2d99d1dafde008 in 1661ms, sequenceid=23, compaction requested=true 2023-02-09 16:55:55,804 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 89b5638a4d4b48414e2d99d1dafde008: 2023-02-09 16:55:55,804 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for d5ef12f1d65f6f85f477fbd699fd3cf9 in 1661ms, sequenceid=23, compaction requested=true 2023-02-09 16:55:55,804 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1675961746226.89b5638a4d4b48414e2d99d1dafde008. 2023-02-09 16:55:55,804 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for d5ef12f1d65f6f85f477fbd699fd3cf9: 2023-02-09 16:55:55,805 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-09 16:55:55,805 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1675961746226.d5ef12f1d65f6f85f477fbd699fd3cf9. 2023-02-09 16:55:55,805 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-09 16:55:55,805 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-09 16:55:55,805 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:55,805 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-02-09 16:55:55,805 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-02-09 16:55:55,806 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:55,806 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 16:55:55,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:55,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:55:55,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:55:55,807 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 16:55:55,807 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:55:55,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:55:55,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:55:55,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 16:55:55,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:55,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:55:55,808 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-02-09 16:55:55,808 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@79f64881[Count = 0] remaining members to acquire global barrier 2023-02-09 16:55:55,808 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-02-09 16:55:55,808 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 16:55:55,809 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 16:55:55,809 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 16:55:55,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 16:55:55,809 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-02-09 16:55:55,809 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-02-09 16:55:55,809 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:55:55,809 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:55,809 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:55:55,810 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-02-09 16:55:55,810 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:55,810 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:55:55,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:55,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:55:55,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:55:55,810 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-02-09 16:55:55,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:55:55,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:55:55,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 16:55:55,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:55,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:55:55,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 16:55:55,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:55,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:55:55,812 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-02-09 16:55:55,812 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-02-09 16:55:55,813 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:55:55,813 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:55:55,813 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-02-09 16:55:55,813 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:55:55,818 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 16:55:55,818 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 16:55:55,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 16:55:55,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:55:55,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:55:55,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 16:55:55,818 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:55:55,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 16:55:55,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:55:55,819 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:55:55,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:55:55,819 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:55,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 16:55:55,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 16:55:55,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:55:55,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 16:55:55,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:55,820 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:55,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:55:55,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 16:55:55,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:55,822 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:55,822 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-09 16:55:55,822 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:55:55,822 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-09 16:55:55,822 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-02-09 16:55:55,822 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:55:55,822 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-02-09 16:55:55,822 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:55:55,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:55:55,822 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:55:55,822 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:55:55,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:55:55,822 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 16:55:55,822 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 16:55:55,822 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 16:55:55,822 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-02-09 16:55:55,822 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:55:55,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:55:55,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:55:55,923 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:55:55,923 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:55:55,923 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:55:55,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:55:55,924 DEBUG [Listener at localhost/41619] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-09 16:55:55,924 DEBUG [Listener at localhost/41619] regionserver.HStore(1912): 89b5638a4d4b48414e2d99d1dafde008/family1 is initiating major compaction (all files) 2023-02-09 16:55:55,924 INFO [Listener at localhost/41619] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 16:55:55,924 INFO [Listener at localhost/41619] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 16:55:55,925 INFO [Listener at localhost/41619] regionserver.HRegion(2258): Starting compaction of 89b5638a4d4b48414e2d99d1dafde008/family1 in ns:testMinorCompaction,,1675961746226.89b5638a4d4b48414e2d99d1dafde008. 2023-02-09 16:55:55,925 INFO [Listener at localhost/41619] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/family1/7bbe76d4711e4e94a4458374f90ee9f4, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/family1/ca923ea3810f4e29ae16a060996e75c5, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/family1/b6d0db7b6e854b979dd4bc2562d8f1a9, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/family1/5518a41eada243ec87236a067bab81da, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/family1/fae1c04bfb3b4167800ef998b21ecddf] into tmpdir=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/.tmp, totalSize=26.6 K 2023-02-09 16:55:55,925 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting 7bbe76d4711e4e94a4458374f90ee9f4, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675961747340 2023-02-09 16:55:55,926 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting ca923ea3810f4e29ae16a060996e75c5, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675961749118 2023-02-09 16:55:55,926 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting b6d0db7b6e854b979dd4bc2562d8f1a9, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675961750900 2023-02-09 16:55:55,926 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting 5518a41eada243ec87236a067bab81da, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675961752684 2023-02-09 16:55:55,927 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting fae1c04bfb3b4167800ef998b21ecddf, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-09 16:55:55,937 INFO [Listener at localhost/41619] throttle.PressureAwareThroughputController(145): 89b5638a4d4b48414e2d99d1dafde008#family1#compaction#150 average throughput is 0.55 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 16:55:56,345 INFO [Listener at localhost/41619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230209303cfe37779d4655bc5b0af9e7f75735_del 2023-02-09 16:55:56,345 INFO [Listener at localhost/41619] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230209303cfe37779d4655bc5b0af9e7f75735_del to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230209303cfe37779d4655bc5b0af9e7f75735_del 2023-02-09 16:55:57,159 INFO [Listener at localhost/41619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ebe3ef2f4c23419fb2395fcf1d286d88 2023-02-09 16:55:57,160 DEBUG [Listener at localhost/41619] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/.tmp/family1/ebe3ef2f4c23419fb2395fcf1d286d88 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/family1/ebe3ef2f4c23419fb2395fcf1d286d88 2023-02-09 16:55:57,163 INFO [Listener at localhost/41619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ebe3ef2f4c23419fb2395fcf1d286d88 2023-02-09 16:55:57,164 INFO [Listener at localhost/41619] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 89b5638a4d4b48414e2d99d1dafde008/family1 of 89b5638a4d4b48414e2d99d1dafde008 into ebe3ef2f4c23419fb2395fcf1d286d88(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-09 16:55:57,164 DEBUG [Listener at localhost/41619] regionserver.HRegion(2288): Compaction status journal for 89b5638a4d4b48414e2d99d1dafde008: 2023-02-09 16:55:57,164 DEBUG [Listener at localhost/41619] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-09 16:55:57,164 DEBUG [Listener at localhost/41619] regionserver.HStore(1912): 89b5638a4d4b48414e2d99d1dafde008/family2 is initiating major compaction (all files) 2023-02-09 16:55:57,164 INFO [Listener at localhost/41619] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 16:55:57,164 INFO [Listener at localhost/41619] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 16:55:57,164 INFO [Listener at localhost/41619] regionserver.HRegion(2258): Starting compaction of 89b5638a4d4b48414e2d99d1dafde008/family2 in ns:testMinorCompaction,,1675961746226.89b5638a4d4b48414e2d99d1dafde008. 2023-02-09 16:55:57,164 INFO [Listener at localhost/41619] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/family2/82a5cf0a6b6b40a5a4cac108cf2d4b54, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/family2/a7797c4f95d84753b216e413e46c12c8, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/family2/dbf613606dff4602a7992bbdf0ea0253, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/family2/93d2cc4c8b484c69b02702c4f9bf0c3f, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/family2/ab1827ed1ef640a3ae2c2342362f8b43] into tmpdir=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/.tmp, totalSize=25.3 K 2023-02-09 16:55:57,165 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting 82a5cf0a6b6b40a5a4cac108cf2d4b54, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675961747340 2023-02-09 16:55:57,165 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting a7797c4f95d84753b216e413e46c12c8, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675961749118 2023-02-09 16:55:57,166 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting dbf613606dff4602a7992bbdf0ea0253, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675961750900 2023-02-09 16:55:57,166 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting 93d2cc4c8b484c69b02702c4f9bf0c3f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675961752684 2023-02-09 16:55:57,166 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting ab1827ed1ef640a3ae2c2342362f8b43, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-09 16:55:57,177 INFO [Listener at localhost/41619] throttle.PressureAwareThroughputController(145): 89b5638a4d4b48414e2d99d1dafde008#family2#compaction#151 average throughput is 0.25 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 16:55:57,186 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/family1/7bbe76d4711e4e94a4458374f90ee9f4, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/family1/ca923ea3810f4e29ae16a060996e75c5, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/family1/b6d0db7b6e854b979dd4bc2562d8f1a9, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/family1/5518a41eada243ec87236a067bab81da, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/family1/fae1c04bfb3b4167800ef998b21ecddf] to archive 2023-02-09 16:55:57,186 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 16:55:57,188 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/family1/7bbe76d4711e4e94a4458374f90ee9f4 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/family1/7bbe76d4711e4e94a4458374f90ee9f4 2023-02-09 16:55:57,190 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/family1/ca923ea3810f4e29ae16a060996e75c5 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/family1/ca923ea3810f4e29ae16a060996e75c5 2023-02-09 16:55:57,193 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/family1/b6d0db7b6e854b979dd4bc2562d8f1a9 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/family1/b6d0db7b6e854b979dd4bc2562d8f1a9 2023-02-09 16:55:57,194 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/family1/5518a41eada243ec87236a067bab81da to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/family1/5518a41eada243ec87236a067bab81da 2023-02-09 16:55:57,196 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/family1/fae1c04bfb3b4167800ef998b21ecddf to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/family1/fae1c04bfb3b4167800ef998b21ecddf 2023-02-09 16:55:57,586 INFO [Listener at localhost/41619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230209b7814d5ee4794645a54a173183d4718e_del 2023-02-09 16:55:57,586 INFO [Listener at localhost/41619] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230209b7814d5ee4794645a54a173183d4718e_del to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20230209b7814d5ee4794645a54a173183d4718e_del 2023-02-09 16:55:57,999 INFO [Listener at localhost/41619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0113842605694adcb8851fc94bdbb397 2023-02-09 16:55:58,000 DEBUG [Listener at localhost/41619] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/.tmp/family2/0113842605694adcb8851fc94bdbb397 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/family2/0113842605694adcb8851fc94bdbb397 2023-02-09 16:55:58,003 INFO [Listener at localhost/41619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0113842605694adcb8851fc94bdbb397 2023-02-09 16:55:58,004 INFO [Listener at localhost/41619] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 89b5638a4d4b48414e2d99d1dafde008/family2 of 89b5638a4d4b48414e2d99d1dafde008 into 0113842605694adcb8851fc94bdbb397(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-09 16:55:58,004 DEBUG [Listener at localhost/41619] regionserver.HRegion(2288): Compaction status journal for 89b5638a4d4b48414e2d99d1dafde008: 2023-02-09 16:55:58,005 DEBUG [Listener at localhost/41619] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-09 16:55:58,005 DEBUG [Listener at localhost/41619] regionserver.HStore(1912): c804397231ed8faa5ea2759a18ad370d/family1 is initiating major compaction (all files) 2023-02-09 16:55:58,005 INFO [Listener at localhost/41619] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 16:55:58,005 INFO [Listener at localhost/41619] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 16:55:58,005 INFO [Listener at localhost/41619] regionserver.HRegion(2258): Starting compaction of c804397231ed8faa5ea2759a18ad370d/family1 in ns:testMinorCompaction,2,1675961746226.c804397231ed8faa5ea2759a18ad370d. 2023-02-09 16:55:58,005 INFO [Listener at localhost/41619] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/family1/8792351214754918ba629123a87a0533, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/family1/db08c206636d4f8594a9d88a9fae904b, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/family1/e2658d34d3e742feab444f32b3328e14, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/family1/5802c5017e1b42a5af6e0e48df395026, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/family1/dfff5da4450b427e812052c8a21e67ab] into tmpdir=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/.tmp, totalSize=26.6 K 2023-02-09 16:55:58,005 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting 8792351214754918ba629123a87a0533, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675961747341 2023-02-09 16:55:58,006 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting db08c206636d4f8594a9d88a9fae904b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675961749119 2023-02-09 16:55:58,006 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting e2658d34d3e742feab444f32b3328e14, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675961750901 2023-02-09 16:55:58,006 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting 5802c5017e1b42a5af6e0e48df395026, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675961752685 2023-02-09 16:55:58,007 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting dfff5da4450b427e812052c8a21e67ab, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-09 16:55:58,015 INFO [Listener at localhost/41619] throttle.PressureAwareThroughputController(145): c804397231ed8faa5ea2759a18ad370d#family1#compaction#152 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 16:55:58,022 INFO [Listener at localhost/41619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230209eede00b15dc4473c8a4652986283da68_del 2023-02-09 16:55:58,022 INFO [Listener at localhost/41619] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230209eede00b15dc4473c8a4652986283da68_del to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230209eede00b15dc4473c8a4652986283da68_del 2023-02-09 16:55:58,085 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/family2/82a5cf0a6b6b40a5a4cac108cf2d4b54, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/family2/a7797c4f95d84753b216e413e46c12c8, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/family2/dbf613606dff4602a7992bbdf0ea0253, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/family2/93d2cc4c8b484c69b02702c4f9bf0c3f, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/family2/ab1827ed1ef640a3ae2c2342362f8b43] to archive 2023-02-09 16:55:58,086 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 16:55:58,088 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/family2/82a5cf0a6b6b40a5a4cac108cf2d4b54 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/family2/82a5cf0a6b6b40a5a4cac108cf2d4b54 2023-02-09 16:55:58,089 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/family2/a7797c4f95d84753b216e413e46c12c8 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/family2/a7797c4f95d84753b216e413e46c12c8 2023-02-09 16:55:58,091 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/family2/dbf613606dff4602a7992bbdf0ea0253 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/family2/dbf613606dff4602a7992bbdf0ea0253 2023-02-09 16:55:58,092 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/family2/93d2cc4c8b484c69b02702c4f9bf0c3f to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/family2/93d2cc4c8b484c69b02702c4f9bf0c3f 2023-02-09 16:55:58,093 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/family2/ab1827ed1ef640a3ae2c2342362f8b43 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/family2/ab1827ed1ef640a3ae2c2342362f8b43 2023-02-09 16:55:58,836 INFO [Listener at localhost/41619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1a5a250866d84fb98394171fcb5ef6ae 2023-02-09 16:55:58,837 DEBUG [Listener at localhost/41619] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/.tmp/family1/1a5a250866d84fb98394171fcb5ef6ae as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/family1/1a5a250866d84fb98394171fcb5ef6ae 2023-02-09 16:55:58,841 INFO [Listener at localhost/41619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1a5a250866d84fb98394171fcb5ef6ae 2023-02-09 16:55:58,842 INFO [Listener at localhost/41619] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in c804397231ed8faa5ea2759a18ad370d/family1 of c804397231ed8faa5ea2759a18ad370d into 1a5a250866d84fb98394171fcb5ef6ae(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-09 16:55:58,842 DEBUG [Listener at localhost/41619] regionserver.HRegion(2288): Compaction status journal for c804397231ed8faa5ea2759a18ad370d: 2023-02-09 16:55:58,842 DEBUG [Listener at localhost/41619] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-09 16:55:58,843 DEBUG [Listener at localhost/41619] regionserver.HStore(1912): c804397231ed8faa5ea2759a18ad370d/family2 is initiating major compaction (all files) 2023-02-09 16:55:58,843 INFO [Listener at localhost/41619] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 16:55:58,843 INFO [Listener at localhost/41619] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 16:55:58,843 INFO [Listener at localhost/41619] regionserver.HRegion(2258): Starting compaction of c804397231ed8faa5ea2759a18ad370d/family2 in ns:testMinorCompaction,2,1675961746226.c804397231ed8faa5ea2759a18ad370d. 2023-02-09 16:55:58,843 INFO [Listener at localhost/41619] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/family2/077edc7a75874a83950312e3a77c0a68, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/family2/fafc06d46b844d60a09947ddc06b961b, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/family2/9ae43199092f4f1aba75980d8e0cd096, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/family2/bf24362186234f0b980413a20777d6d2, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/family2/5ffe70704ff94d28ae4929d76597f1b7] into tmpdir=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/.tmp, totalSize=25.3 K 2023-02-09 16:55:58,843 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting 077edc7a75874a83950312e3a77c0a68, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675961747341 2023-02-09 16:55:58,844 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting fafc06d46b844d60a09947ddc06b961b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675961749119 2023-02-09 16:55:58,844 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting 9ae43199092f4f1aba75980d8e0cd096, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675961750901 2023-02-09 16:55:58,844 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting bf24362186234f0b980413a20777d6d2, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675961752685 2023-02-09 16:55:58,845 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting 5ffe70704ff94d28ae4929d76597f1b7, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-09 16:55:58,853 INFO [Listener at localhost/41619] throttle.PressureAwareThroughputController(145): c804397231ed8faa5ea2759a18ad370d#family2#compaction#153 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 16:55:58,886 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/family1/8792351214754918ba629123a87a0533, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/family1/db08c206636d4f8594a9d88a9fae904b, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/family1/e2658d34d3e742feab444f32b3328e14, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/family1/5802c5017e1b42a5af6e0e48df395026, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/family1/dfff5da4450b427e812052c8a21e67ab] to archive 2023-02-09 16:55:58,886 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 16:55:58,888 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/family1/8792351214754918ba629123a87a0533 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/family1/8792351214754918ba629123a87a0533 2023-02-09 16:55:58,889 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/family1/db08c206636d4f8594a9d88a9fae904b to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/family1/db08c206636d4f8594a9d88a9fae904b 2023-02-09 16:55:58,890 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/family1/e2658d34d3e742feab444f32b3328e14 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/family1/e2658d34d3e742feab444f32b3328e14 2023-02-09 16:55:58,891 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/family1/5802c5017e1b42a5af6e0e48df395026 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/family1/5802c5017e1b42a5af6e0e48df395026 2023-02-09 16:55:58,892 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/family1/dfff5da4450b427e812052c8a21e67ab to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/family1/dfff5da4450b427e812052c8a21e67ab 2023-02-09 16:55:59,261 INFO [Listener at localhost/41619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023020910b0199daa584967a1ebea1c95c1fed4_del 2023-02-09 16:55:59,261 INFO [Listener at localhost/41619] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023020910b0199daa584967a1ebea1c95c1fed4_del to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c2023020910b0199daa584967a1ebea1c95c1fed4_del 2023-02-09 16:55:59,676 INFO [Listener at localhost/41619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bc4b073d6e814a7da34cbc393d00714f 2023-02-09 16:55:59,677 DEBUG [Listener at localhost/41619] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/.tmp/family2/bc4b073d6e814a7da34cbc393d00714f as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/family2/bc4b073d6e814a7da34cbc393d00714f 2023-02-09 16:55:59,680 INFO [Listener at localhost/41619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bc4b073d6e814a7da34cbc393d00714f 2023-02-09 16:55:59,681 INFO [Listener at localhost/41619] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in c804397231ed8faa5ea2759a18ad370d/family2 of c804397231ed8faa5ea2759a18ad370d into bc4b073d6e814a7da34cbc393d00714f(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-09 16:55:59,682 DEBUG [Listener at localhost/41619] regionserver.HRegion(2288): Compaction status journal for c804397231ed8faa5ea2759a18ad370d: 2023-02-09 16:55:59,682 DEBUG [Listener at localhost/41619] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-09 16:55:59,682 DEBUG [Listener at localhost/41619] regionserver.HStore(1912): d5ef12f1d65f6f85f477fbd699fd3cf9/family1 is initiating major compaction (all files) 2023-02-09 16:55:59,682 INFO [Listener at localhost/41619] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 16:55:59,682 INFO [Listener at localhost/41619] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 16:55:59,682 INFO [Listener at localhost/41619] regionserver.HRegion(2258): Starting compaction of d5ef12f1d65f6f85f477fbd699fd3cf9/family1 in ns:testMinorCompaction,1,1675961746226.d5ef12f1d65f6f85f477fbd699fd3cf9. 2023-02-09 16:55:59,682 INFO [Listener at localhost/41619] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/family1/805a1e5e3a2f4ae69b7565a18c4be8ae, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/family1/f372430d438248bf80220cf9d9eb35bb, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/family1/a576784d0da2417f89b873bd3e7e144c, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/family1/7977a7804a0a47fca53e5396d7bbe2d8, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/family1/4af9e73ea7b94afd987d8b561154ee3e] into tmpdir=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/.tmp, totalSize=26.6 K 2023-02-09 16:55:59,682 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting 805a1e5e3a2f4ae69b7565a18c4be8ae, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675961747341 2023-02-09 16:55:59,683 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting f372430d438248bf80220cf9d9eb35bb, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675961749119 2023-02-09 16:55:59,683 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting a576784d0da2417f89b873bd3e7e144c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675961750900 2023-02-09 16:55:59,684 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting 7977a7804a0a47fca53e5396d7bbe2d8, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675961752685 2023-02-09 16:55:59,684 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting 4af9e73ea7b94afd987d8b561154ee3e, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-09 16:55:59,686 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/family2/077edc7a75874a83950312e3a77c0a68, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/family2/fafc06d46b844d60a09947ddc06b961b, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/family2/9ae43199092f4f1aba75980d8e0cd096, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/family2/bf24362186234f0b980413a20777d6d2, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/family2/5ffe70704ff94d28ae4929d76597f1b7] to archive 2023-02-09 16:55:59,686 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 16:55:59,688 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/family2/077edc7a75874a83950312e3a77c0a68 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/family2/077edc7a75874a83950312e3a77c0a68 2023-02-09 16:55:59,689 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/family2/fafc06d46b844d60a09947ddc06b961b to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/family2/fafc06d46b844d60a09947ddc06b961b 2023-02-09 16:55:59,691 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/family2/9ae43199092f4f1aba75980d8e0cd096 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/family2/9ae43199092f4f1aba75980d8e0cd096 2023-02-09 16:55:59,692 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/family2/bf24362186234f0b980413a20777d6d2 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/family2/bf24362186234f0b980413a20777d6d2 2023-02-09 16:55:59,693 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/family2/5ffe70704ff94d28ae4929d76597f1b7 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/family2/5ffe70704ff94d28ae4929d76597f1b7 2023-02-09 16:55:59,696 INFO [Listener at localhost/41619] throttle.PressureAwareThroughputController(145): d5ef12f1d65f6f85f477fbd699fd3cf9#family1#compaction#154 average throughput is 0.55 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 16:56:00,107 INFO [Listener at localhost/41619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023020929f26fc9b9694e989e20c98df34ef9b3_del 2023-02-09 16:56:00,107 INFO [Listener at localhost/41619] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023020929f26fc9b9694e989e20c98df34ef9b3_del to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023020929f26fc9b9694e989e20c98df34ef9b3_del 2023-02-09 16:56:00,935 INFO [Listener at localhost/41619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ad81ca35b3e44f23931513f0ecc6a2da 2023-02-09 16:56:00,935 DEBUG [Listener at localhost/41619] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/.tmp/family1/ad81ca35b3e44f23931513f0ecc6a2da as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/family1/ad81ca35b3e44f23931513f0ecc6a2da 2023-02-09 16:56:00,941 INFO [Listener at localhost/41619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ad81ca35b3e44f23931513f0ecc6a2da 2023-02-09 16:56:00,942 INFO [Listener at localhost/41619] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in d5ef12f1d65f6f85f477fbd699fd3cf9/family1 of d5ef12f1d65f6f85f477fbd699fd3cf9 into ad81ca35b3e44f23931513f0ecc6a2da(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-09 16:56:00,942 DEBUG [Listener at localhost/41619] regionserver.HRegion(2288): Compaction status journal for d5ef12f1d65f6f85f477fbd699fd3cf9: 2023-02-09 16:56:00,942 DEBUG [Listener at localhost/41619] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-09 16:56:00,942 DEBUG [Listener at localhost/41619] regionserver.HStore(1912): d5ef12f1d65f6f85f477fbd699fd3cf9/family2 is initiating major compaction (all files) 2023-02-09 16:56:00,943 INFO [Listener at localhost/41619] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 16:56:00,943 INFO [Listener at localhost/41619] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 16:56:00,943 INFO [Listener at localhost/41619] regionserver.HRegion(2258): Starting compaction of d5ef12f1d65f6f85f477fbd699fd3cf9/family2 in ns:testMinorCompaction,1,1675961746226.d5ef12f1d65f6f85f477fbd699fd3cf9. 2023-02-09 16:56:00,943 INFO [Listener at localhost/41619] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/family2/8adb2211f5c04aac9d935fd4d69022ad, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/family2/7b0c1990d5f344b88c25d55afbd4a8cf, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/family2/c5aae8deaf734d6bad835c1e6c296062, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/family2/38a4421bb2c34621b39cd5a428b2f209, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/family2/42dc85c72b2e45bc87327a0332550f7f] into tmpdir=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/.tmp, totalSize=25.3 K 2023-02-09 16:56:00,943 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting 8adb2211f5c04aac9d935fd4d69022ad, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675961747341 2023-02-09 16:56:00,944 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting 7b0c1990d5f344b88c25d55afbd4a8cf, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675961749119 2023-02-09 16:56:00,944 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting c5aae8deaf734d6bad835c1e6c296062, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675961750900 2023-02-09 16:56:00,944 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting 38a4421bb2c34621b39cd5a428b2f209, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675961752685 2023-02-09 16:56:00,945 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting 42dc85c72b2e45bc87327a0332550f7f, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-09 16:56:00,956 INFO [Listener at localhost/41619] throttle.PressureAwareThroughputController(145): d5ef12f1d65f6f85f477fbd699fd3cf9#family2#compaction#155 average throughput is 0.25 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 16:56:00,967 INFO [Listener at localhost/41619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230209e2eecfd0967246acb1749a8d45a1d05b_del 2023-02-09 16:56:00,967 INFO [Listener at localhost/41619] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230209e2eecfd0967246acb1749a8d45a1d05b_del to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20230209e2eecfd0967246acb1749a8d45a1d05b_del 2023-02-09 16:56:00,990 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/family1/805a1e5e3a2f4ae69b7565a18c4be8ae, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/family1/f372430d438248bf80220cf9d9eb35bb, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/family1/a576784d0da2417f89b873bd3e7e144c, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/family1/7977a7804a0a47fca53e5396d7bbe2d8, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/family1/4af9e73ea7b94afd987d8b561154ee3e] to archive 2023-02-09 16:56:00,992 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 16:56:00,994 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/family1/805a1e5e3a2f4ae69b7565a18c4be8ae to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/family1/805a1e5e3a2f4ae69b7565a18c4be8ae 2023-02-09 16:56:00,995 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/family1/f372430d438248bf80220cf9d9eb35bb to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/family1/f372430d438248bf80220cf9d9eb35bb 2023-02-09 16:56:00,996 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/family1/a576784d0da2417f89b873bd3e7e144c to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/family1/a576784d0da2417f89b873bd3e7e144c 2023-02-09 16:56:00,997 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/family1/7977a7804a0a47fca53e5396d7bbe2d8 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/family1/7977a7804a0a47fca53e5396d7bbe2d8 2023-02-09 16:56:00,999 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/family1/4af9e73ea7b94afd987d8b561154ee3e to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/family1/4af9e73ea7b94afd987d8b561154ee3e 2023-02-09 16:56:01,390 INFO [Listener at localhost/41619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6b1a00a89a2c4181982f2db0969ec48d 2023-02-09 16:56:01,390 DEBUG [Listener at localhost/41619] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/.tmp/family2/6b1a00a89a2c4181982f2db0969ec48d as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/family2/6b1a00a89a2c4181982f2db0969ec48d 2023-02-09 16:56:01,399 INFO [Listener at localhost/41619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6b1a00a89a2c4181982f2db0969ec48d 2023-02-09 16:56:01,400 INFO [Listener at localhost/41619] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in d5ef12f1d65f6f85f477fbd699fd3cf9/family2 of d5ef12f1d65f6f85f477fbd699fd3cf9 into 6b1a00a89a2c4181982f2db0969ec48d(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-09 16:56:01,400 DEBUG [Listener at localhost/41619] regionserver.HRegion(2288): Compaction status journal for d5ef12f1d65f6f85f477fbd699fd3cf9: 2023-02-09 16:56:01,403 DEBUG [Listener at localhost/41619] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-09 16:56:01,406 DEBUG [Listener at localhost/41619] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-09 16:56:01,410 DEBUG [Listener at localhost/41619] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-09 16:56:01,411 DEBUG [Listener at localhost/41619] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-09 16:56:01,423 INFO [Listener at localhost/41619] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-09 16:56:01,439 INFO [Listener at localhost/41619] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 3 del files, 3 selected files, and 0 irrelevant files table 'ns:testMinorCompaction' and column 'family1' 2023-02-09 16:56:01,442 INFO [Listener at localhost/41619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230209303cfe37779d4655bc5b0af9e7f75735_del 2023-02-09 16:56:01,445 INFO [Listener at localhost/41619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023020929f26fc9b9694e989e20c98df34ef9b3_del 2023-02-09 16:56:01,448 INFO [Listener at localhost/41619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230209eede00b15dc4473c8a4652986283da68_del 2023-02-09 16:56:01,448 INFO [Listener at localhost/41619] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='ns:testMinorCompaction' column='family1' 2023-02-09 16:56:01,448 DEBUG [Listener at localhost/41619] zookeeper.ReadOnlyZKClient(139): Connect 0x48ee0a65 to 127.0.0.1:53887 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 16:56:01,453 DEBUG [Listener at localhost/41619] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5dd9506e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 16:56:01,454 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230209 for table='ns:testMinorCompaction' and column='family1' 2023-02-09 16:56:01,454 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230209 for table='ns:testMinorCompaction' and column='family1' 2023-02-09 16:56:01,454 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230209 for table='ns:testMinorCompaction' and column='family1' 2023-02-09 16:56:01,486 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/family2/8adb2211f5c04aac9d935fd4d69022ad, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/family2/7b0c1990d5f344b88c25d55afbd4a8cf, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/family2/c5aae8deaf734d6bad835c1e6c296062, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/family2/38a4421bb2c34621b39cd5a428b2f209, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/family2/42dc85c72b2e45bc87327a0332550f7f] to archive 2023-02-09 16:56:01,488 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 16:56:01,491 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/family2/8adb2211f5c04aac9d935fd4d69022ad to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/family2/8adb2211f5c04aac9d935fd4d69022ad 2023-02-09 16:56:01,492 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/family2/7b0c1990d5f344b88c25d55afbd4a8cf to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/family2/7b0c1990d5f344b88c25d55afbd4a8cf 2023-02-09 16:56:01,494 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/family2/c5aae8deaf734d6bad835c1e6c296062 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/family2/c5aae8deaf734d6bad835c1e6c296062 2023-02-09 16:56:01,495 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/family2/38a4421bb2c34621b39cd5a428b2f209 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/family2/38a4421bb2c34621b39cd5a428b2f209 2023-02-09 16:56:01,497 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/family2/42dc85c72b2e45bc87327a0332550f7f to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/family2/42dc85c72b2e45bc87327a0332550f7f 2023-02-09 16:56:01,540 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230209037a5f78242a4600b3ba2d3a5646d1c8 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230209037a5f78242a4600b3ba2d3a5646d1c8 2023-02-09 16:56:01,541 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230209 table='ns:testMinorCompaction' column='family1' 2023-02-09 16:56:01,549 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230209c0eeb72daf9a45158521aae27140c48f to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230209c0eeb72daf9a45158521aae27140c48f 2023-02-09 16:56:01,550 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230209 table='ns:testMinorCompaction' column='family1' 2023-02-09 16:56:01,552 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302090375ae1a7a7c482fab2427e2d001cfc1 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202302090375ae1a7a7c482fab2427e2d001cfc1 2023-02-09 16:56:01,553 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230209 table='ns:testMinorCompaction' column='family1' 2023-02-09 16:56:01,557 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 16:56:01,560 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55932, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 16:56:01,571 INFO [MobFileCompactionChore-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:56:01,572 INFO [MobFileCompactionChore-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:56:01,572 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-09 16:56:01,580 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36976, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-09 16:56:01,582 INFO [MobFileCompactionChore-pool-2] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:56:01,582 INFO [MobFileCompactionChore-pool-2] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:56:01,584 INFO [MobFileCompactionChore-pool-1] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:56:01,585 INFO [MobFileCompactionChore-pool-1] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:56:01,609 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230209/family1/07438405cb954e30b59b3a647106f29b first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x01] 2023-02-09 16:56:01,610 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230209/family1/8e2707c671244ae593c22868abec2616 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x01] 2023-02-09 16:56:01,611 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=ns:testMinorCompaction,2,1675961746226.c804397231ed8faa5ea2759a18ad370d., hostname=jenkins-hbase4.apache.org,35511,1675961620699, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230209/family1/07438405cb954e30b59b3a647106f29b}] 2023-02-09 16:56:01,611 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=ns:testMinorCompaction,1,1675961746226.d5ef12f1d65f6f85f477fbd699fd3cf9., hostname=jenkins-hbase4.apache.org,35511,1675961620699, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230209/family1/8e2707c671244ae593c22868abec2616}] 2023-02-09 16:56:01,613 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230209/family1/10bc23fe05234cdfa8bb04ce48caf3da first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x01] 2023-02-09 16:56:01,615 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=ns:testMinorCompaction,,1675961746226.89b5638a4d4b48414e2d99d1dafde008., hostname=jenkins-hbase4.apache.org,35511,1675961620699, seqNum=2 for row with hfile group [{family1,hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230209/family1/10bc23fe05234cdfa8bb04ce48caf3da}] 2023-02-09 16:56:01,622 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35511] regionserver.HStore(763): Validating hfile at hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230209/family1/10bc23fe05234cdfa8bb04ce48caf3da for inclusion in 89b5638a4d4b48414e2d99d1dafde008/family1 2023-02-09 16:56:01,623 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.HStore(763): Validating hfile at hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230209/family1/07438405cb954e30b59b3a647106f29b for inclusion in c804397231ed8faa5ea2759a18ad370d/family1 2023-02-09 16:56:01,623 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(763): Validating hfile at hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230209/family1/8e2707c671244ae593c22868abec2616 for inclusion in d5ef12f1d65f6f85f477fbd699fd3cf9/family1 2023-02-09 16:56:01,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x01 2023-02-09 16:56:01,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(777): Region bounds: first=1 last=2 2023-02-09 16:56:01,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x01 2023-02-09 16:56:01,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.HStore(777): Region bounds: first=2 last= 2023-02-09 16:56:01,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35511] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x01 2023-02-09 16:56:01,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HRegion(2445): Flush status journal for d5ef12f1d65f6f85f477fbd699fd3cf9: 2023-02-09 16:56:01,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.HRegion(2445): Flush status journal for c804397231ed8faa5ea2759a18ad370d: 2023-02-09 16:56:01,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35511] regionserver.HStore(777): Region bounds: first= last=1 2023-02-09 16:56:01,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35511] regionserver.HRegion(2445): Flush status journal for 89b5638a4d4b48414e2d99d1dafde008: 2023-02-09 16:56:01,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230209/family1/07438405cb954e30b59b3a647106f29b to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__ns_testMinorCompaction__4vggp6cs3rft8saf7514lg4fe1e6h21uvjfmkflk1jp0spncim36ohvci6jotq3t/family1/07438405cb954e30b59b3a647106f29b 2023-02-09 16:56:01,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230209/family1/8e2707c671244ae593c22868abec2616 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__ns_testMinorCompaction__f1s75a7t162s65lq745vjkqs4n6t84p3ou80kh3qpqi08fb17feu3g5ksu66h0d9/family1/8e2707c671244ae593c22868abec2616 2023-02-09 16:56:01,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35511] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230209/family1/10bc23fe05234cdfa8bb04ce48caf3da to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__ns_testMinorCompaction__a20jvrki8der5jftbia7dgfrp3gu5qtgfhcsuulqnsl7sal0vpsrdtcjvarphiu1/family1/10bc23fe05234cdfa8bb04ce48caf3da 2023-02-09 16:56:01,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__ns_testMinorCompaction__4vggp6cs3rft8saf7514lg4fe1e6h21uvjfmkflk1jp0spncim36ohvci6jotq3t/family1/07438405cb954e30b59b3a647106f29b as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/family1/af8237d4b0a343b7ac4149679743aa7e_SeqId_28_ 2023-02-09 16:56:01,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__ns_testMinorCompaction__f1s75a7t162s65lq745vjkqs4n6t84p3ou80kh3qpqi08fb17feu3g5ksu66h0d9/family1/8e2707c671244ae593c22868abec2616 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/family1/311fc03ccdc14c999009ad5286df20b7_SeqId_28_ 2023-02-09 16:56:01,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35511] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__ns_testMinorCompaction__a20jvrki8der5jftbia7dgfrp3gu5qtgfhcsuulqnsl7sal0vpsrdtcjvarphiu1/family1/10bc23fe05234cdfa8bb04ce48caf3da as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/family1/9bedf8869fe54ce396e58314056e9a4b_SeqId_28_ 2023-02-09 16:56:01,633 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.HStore(849): Loaded HFile hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__ns_testMinorCompaction__4vggp6cs3rft8saf7514lg4fe1e6h21uvjfmkflk1jp0spncim36ohvci6jotq3t/family1/07438405cb954e30b59b3a647106f29b into c804397231ed8faa5ea2759a18ad370d/family1 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/family1/af8237d4b0a343b7ac4149679743aa7e_SeqId_28_ - updating store file list. 2023-02-09 16:56:01,634 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(849): Loaded HFile hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__ns_testMinorCompaction__f1s75a7t162s65lq745vjkqs4n6t84p3ou80kh3qpqi08fb17feu3g5ksu66h0d9/family1/8e2707c671244ae593c22868abec2616 into d5ef12f1d65f6f85f477fbd699fd3cf9/family1 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/family1/311fc03ccdc14c999009ad5286df20b7_SeqId_28_ - updating store file list. 2023-02-09 16:56:01,634 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35511] regionserver.HStore(849): Loaded HFile hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__ns_testMinorCompaction__a20jvrki8der5jftbia7dgfrp3gu5qtgfhcsuulqnsl7sal0vpsrdtcjvarphiu1/family1/10bc23fe05234cdfa8bb04ce48caf3da into 89b5638a4d4b48414e2d99d1dafde008/family1 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/family1/9bedf8869fe54ce396e58314056e9a4b_SeqId_28_ - updating store file list. 2023-02-09 16:56:01,652 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.HStore(882): Loaded HFile hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/family1/af8237d4b0a343b7ac4149679743aa7e_SeqId_28_ into c804397231ed8faa5ea2759a18ad370d/family1 2023-02-09 16:56:01,652 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.HStore(855): Successfully loaded hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__ns_testMinorCompaction__4vggp6cs3rft8saf7514lg4fe1e6h21uvjfmkflk1jp0spncim36ohvci6jotq3t/family1/07438405cb954e30b59b3a647106f29b into c804397231ed8faa5ea2759a18ad370d/family1 (new location: hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/family1/af8237d4b0a343b7ac4149679743aa7e_SeqId_28_) 2023-02-09 16:56:01,652 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(882): Loaded HFile hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/family1/311fc03ccdc14c999009ad5286df20b7_SeqId_28_ into d5ef12f1d65f6f85f477fbd699fd3cf9/family1 2023-02-09 16:56:01,652 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.HStore(855): Successfully loaded hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__ns_testMinorCompaction__f1s75a7t162s65lq745vjkqs4n6t84p3ou80kh3qpqi08fb17feu3g5ksu66h0d9/family1/8e2707c671244ae593c22868abec2616 into d5ef12f1d65f6f85f477fbd699fd3cf9/family1 (new location: hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/family1/311fc03ccdc14c999009ad5286df20b7_SeqId_28_) 2023-02-09 16:56:01,653 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35511] regionserver.HStore(882): Loaded HFile hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/family1/9bedf8869fe54ce396e58314056e9a4b_SeqId_28_ into 89b5638a4d4b48414e2d99d1dafde008/family1 2023-02-09 16:56:01,653 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35511] regionserver.HStore(855): Successfully loaded hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__ns_testMinorCompaction__a20jvrki8der5jftbia7dgfrp3gu5qtgfhcsuulqnsl7sal0vpsrdtcjvarphiu1/family1/10bc23fe05234cdfa8bb04ce48caf3da into 89b5638a4d4b48414e2d99d1dafde008/family1 (new location: hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/family1/9bedf8869fe54ce396e58314056e9a4b_SeqId_28_) 2023-02-09 16:56:01,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__ns_testMinorCompaction__4vggp6cs3rft8saf7514lg4fe1e6h21uvjfmkflk1jp0spncim36ohvci6jotq3t/family1/07438405cb954e30b59b3a647106f29b 2023-02-09 16:56:01,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35511] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__ns_testMinorCompaction__f1s75a7t162s65lq745vjkqs4n6t84p3ou80kh3qpqi08fb17feu3g5ksu66h0d9/family1/8e2707c671244ae593c22868abec2616 2023-02-09 16:56:01,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35511] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__ns_testMinorCompaction__a20jvrki8der5jftbia7dgfrp3gu5qtgfhcsuulqnsl7sal0vpsrdtcjvarphiu1/family1/10bc23fe05234cdfa8bb04ce48caf3da 2023-02-09 16:56:01,655 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230209 table='ns:testMinorCompaction' column='family1' 2023-02-09 16:56:01,655 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230209 table='ns:testMinorCompaction' column='family1' 2023-02-09 16:56:01,655 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230209 table='ns:testMinorCompaction' column='family1' 2023-02-09 16:56:01,656 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 16:56:01,656 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 16:56:01,656 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 16:56:01,658 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202302090220106aa16c4e3cad3260cbe97dca16 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202302090220106aa16c4e3cad3260cbe97dca16 2023-02-09 16:56:01,658 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-02-09 16:56:01,658 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230209' 2023-02-09 16:56:01,658 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023020951b157020b6447b4bfaf3a94d4fc6c0f to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023020951b157020b6447b4bfaf3a94d4fc6c0f 2023-02-09 16:56:01,658 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-02-09 16:56:01,658 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230209' 2023-02-09 16:56:01,658 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230209b82305ec31664e9f8ab99add294e93b8 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230209b82305ec31664e9f8ab99add294e93b8 2023-02-09 16:56:01,659 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-02-09 16:56:01,659 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230209' 2023-02-09 16:56:01,659 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230209 for table='ns:testMinorCompaction' and column='family1' 2023-02-09 16:56:01,659 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230209 for table='ns:testMinorCompaction' and column='family1' 2023-02-09 16:56:01,659 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230209 for table='ns:testMinorCompaction' and column='family1' 2023-02-09 16:56:01,659 INFO [Listener at localhost/41619] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='ns:testMinorCompaction' column='family1' 2023-02-09 16:56:01,662 DEBUG [Listener at localhost/41619] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-09 16:56:01,664 DEBUG [Listener at localhost/41619] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-09 16:56:01,667 DEBUG [Listener at localhost/41619] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-09 16:56:01,668 DEBUG [Listener at localhost/41619] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-09 16:56:01,694 INFO [Listener at localhost/41619] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompaction Thread=256 (was 283), OpenFileDescriptor=648 (was 740), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=141 (was 95) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=3477 (was 2937) - AvailableMemoryMB LEAK? - 2023-02-09 16:56:01,711 INFO [Listener at localhost/41619] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=256, OpenFileDescriptor=648, MaxFileDescriptor=60000, SystemLoadAverage=141, ProcessCount=168, AvailableMemoryMB=3476 2023-02-09 16:56:01,712 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:56:01,713 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:56:01,714 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-02-09 16:56:01,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:01,717 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 16:56:01,717 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithMonthlyPolicy" procId is: 112 2023-02-09 16:56:01,718 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:56:01,718 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:56:01,718 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 16:56:01,719 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610 2023-02-09 16:56:01,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-09 16:56:01,720 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610 empty. 2023-02-09 16:56:01,721 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610 2023-02-09 16:56:01,721 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithMonthlyPolicy regions 2023-02-09 16:56:01,820 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:56:01,820 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:56:01,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-09 16:56:02,022 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:56:02,022 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:56:02,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-09 16:56:02,135 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-02-09 16:56:02,136 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7671): creating {ENCODED => a74dd38f0f12c6469fa122f81c49c610, NAME => 'testMinorCompactionWithMonthlyPolicy,,1675961761714.a74dd38f0f12c6469fa122f81c49c610.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp 2023-02-09 16:56:02,149 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(865): Instantiated testMinorCompactionWithMonthlyPolicy,,1675961761714.a74dd38f0f12c6469fa122f81c49c610.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 16:56:02,149 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1603): Closing a74dd38f0f12c6469fa122f81c49c610, disabling compactions & flushes 2023-02-09 16:56:02,149 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1625): Closing region testMinorCompactionWithMonthlyPolicy,,1675961761714.a74dd38f0f12c6469fa122f81c49c610. 2023-02-09 16:56:02,149 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1675961761714.a74dd38f0f12c6469fa122f81c49c610. 2023-02-09 16:56:02,149 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1713): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1675961761714.a74dd38f0f12c6469fa122f81c49c610. after waiting 0 ms 2023-02-09 16:56:02,149 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1723): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1675961761714.a74dd38f0f12c6469fa122f81c49c610. 2023-02-09 16:56:02,149 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1837): Closed testMinorCompactionWithMonthlyPolicy,,1675961761714.a74dd38f0f12c6469fa122f81c49c610. 2023-02-09 16:56:02,149 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1557): Region close journal for a74dd38f0f12c6469fa122f81c49c610: Waiting for close lock at 1675961762149Disabling compacts and flushes for region at 1675961762149Disabling writes for close at 1675961762149Writing region close event to WAL at 1675961762149Closed at 1675961762149 2023-02-09 16:56:02,151 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 16:56:02,152 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithMonthlyPolicy,,1675961761714.a74dd38f0f12c6469fa122f81c49c610.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1675961762152"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675961762152"}]},"ts":"1675961762152"} 2023-02-09 16:56:02,153 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-09 16:56:02,154 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 16:56:02,154 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675961762154"}]},"ts":"1675961762154"} 2023-02-09 16:56:02,155 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-02-09 16:56:02,158 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=a74dd38f0f12c6469fa122f81c49c610, ASSIGN}] 2023-02-09 16:56:02,160 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=a74dd38f0f12c6469fa122f81c49c610, ASSIGN 2023-02-09 16:56:02,160 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=a74dd38f0f12c6469fa122f81c49c610, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35511,1675961620699; forceNewPlan=false, retain=false 2023-02-09 16:56:02,312 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=a74dd38f0f12c6469fa122f81c49c610, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:02,312 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithMonthlyPolicy,,1675961761714.a74dd38f0f12c6469fa122f81c49c610.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1675961762312"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675961762312"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675961762312"}]},"ts":"1675961762312"} 2023-02-09 16:56:02,314 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=114, ppid=113, state=RUNNABLE; OpenRegionProcedure a74dd38f0f12c6469fa122f81c49c610, server=jenkins-hbase4.apache.org,35511,1675961620699}] 2023-02-09 16:56:02,323 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:56:02,323 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:56:02,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-09 16:56:02,468 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMinorCompactionWithMonthlyPolicy,,1675961761714.a74dd38f0f12c6469fa122f81c49c610. 2023-02-09 16:56:02,468 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => a74dd38f0f12c6469fa122f81c49c610, NAME => 'testMinorCompactionWithMonthlyPolicy,,1675961761714.a74dd38f0f12c6469fa122f81c49c610.', STARTKEY => '', ENDKEY => ''} 2023-02-09 16:56:02,468 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithMonthlyPolicy a74dd38f0f12c6469fa122f81c49c610 2023-02-09 16:56:02,469 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMinorCompactionWithMonthlyPolicy,,1675961761714.a74dd38f0f12c6469fa122f81c49c610.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 16:56:02,469 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for a74dd38f0f12c6469fa122f81c49c610 2023-02-09 16:56:02,469 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for a74dd38f0f12c6469fa122f81c49c610 2023-02-09 16:56:02,470 INFO [StoreOpener-a74dd38f0f12c6469fa122f81c49c610-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region a74dd38f0f12c6469fa122f81c49c610 2023-02-09 16:56:02,471 DEBUG [StoreOpener-a74dd38f0f12c6469fa122f81c49c610-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1 2023-02-09 16:56:02,471 DEBUG [StoreOpener-a74dd38f0f12c6469fa122f81c49c610-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1 2023-02-09 16:56:02,472 INFO [StoreOpener-a74dd38f0f12c6469fa122f81c49c610-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a74dd38f0f12c6469fa122f81c49c610 columnFamilyName family1 2023-02-09 16:56:02,473 INFO [StoreOpener-a74dd38f0f12c6469fa122f81c49c610-1] regionserver.HStore(310): Store=a74dd38f0f12c6469fa122f81c49c610/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 16:56:02,474 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610 2023-02-09 16:56:02,474 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610 2023-02-09 16:56:02,477 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for a74dd38f0f12c6469fa122f81c49c610 2023-02-09 16:56:02,478 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 16:56:02,479 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened a74dd38f0f12c6469fa122f81c49c610; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66255190, jitterRate=-0.012720733880996704}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 16:56:02,479 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for a74dd38f0f12c6469fa122f81c49c610: Running coprocessor pre-open hook at 1675961762469Writing region info on filesystem at 1675961762469Initializing all the Stores at 1675961762469Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} at 1675961762470 (+1 ms)Cleaning up temporary data from old regions at 1675961762475 (+5 ms)Cleaning up detritus from prior splits at 1675961762475Running coprocessor post-open hooks at 1675961762479 (+4 ms)Region opened successfully at 1675961762479 2023-02-09 16:56:02,480 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMinorCompactionWithMonthlyPolicy,,1675961761714.a74dd38f0f12c6469fa122f81c49c610., pid=114, masterSystemTime=1675961762465 2023-02-09 16:56:02,481 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMinorCompactionWithMonthlyPolicy,,1675961761714.a74dd38f0f12c6469fa122f81c49c610. 2023-02-09 16:56:02,481 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMinorCompactionWithMonthlyPolicy,,1675961761714.a74dd38f0f12c6469fa122f81c49c610. 2023-02-09 16:56:02,482 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=a74dd38f0f12c6469fa122f81c49c610, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:02,482 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithMonthlyPolicy,,1675961761714.a74dd38f0f12c6469fa122f81c49c610.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1675961762482"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675961762482"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675961762482"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675961762482"}]},"ts":"1675961762482"} 2023-02-09 16:56:02,484 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=114, resume processing ppid=113 2023-02-09 16:56:02,484 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=114, ppid=113, state=SUCCESS; OpenRegionProcedure a74dd38f0f12c6469fa122f81c49c610, server=jenkins-hbase4.apache.org,35511,1675961620699 in 169 msec 2023-02-09 16:56:02,486 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=113, resume processing ppid=112 2023-02-09 16:56:02,486 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=113, ppid=112, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=a74dd38f0f12c6469fa122f81c49c610, ASSIGN in 326 msec 2023-02-09 16:56:02,486 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 16:56:02,486 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675961762486"}]},"ts":"1675961762486"} 2023-02-09 16:56:02,487 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-02-09 16:56:02,491 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 16:56:02,492 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy in 777 msec 2023-02-09 16:56:02,825 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:56:02,825 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:56:02,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-09 16:56:02,826 INFO [Listener at localhost/41619] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithMonthlyPolicy, procId: 112 completed 2023-02-09 16:56:02,850 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:56:02,850 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:56:02,851 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:56:02,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:02,852 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-09 16:56:02,852 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:56:02,852 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-09 16:56:02,852 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-09 16:56:02,853 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:02,853 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:02,855 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:56:02,855 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:02,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:56:02,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:56:02,856 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:02,856 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:56:02,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:02,856 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:02,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:56:02,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:02,856 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:02,857 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:02,857 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-09 16:56:02,857 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:56:02,857 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-09 16:56:02,862 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 16:56:02,862 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:56:02,862 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1675961761714.a74dd38f0f12c6469fa122f81c49c610. 2023-02-09 16:56:02,862 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1675961761714.a74dd38f0f12c6469fa122f81c49c610. started... 2023-02-09 16:56:02,862 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing a74dd38f0f12c6469fa122f81c49c610 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-09 16:56:02,890 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130ca6aca8156794eb084eb18712a8aed03 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130ca6aca8156794eb084eb18712a8aed03 2023-02-09 16:56:03,293 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/.tmp/family1/3c45efdb39314b8ab6c8aef33fac5a73 2023-02-09 16:56:03,297 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/.tmp/family1/3c45efdb39314b8ab6c8aef33fac5a73 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/3c45efdb39314b8ab6c8aef33fac5a73 2023-02-09 16:56:03,300 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/3c45efdb39314b8ab6c8aef33fac5a73, entries=1000, sequenceid=5, filesize=166.0 K 2023-02-09 16:56:03,301 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for a74dd38f0f12c6469fa122f81c49c610 in 439ms, sequenceid=5, compaction requested=false 2023-02-09 16:56:03,301 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithMonthlyPolicy' 2023-02-09 16:56:03,301 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for a74dd38f0f12c6469fa122f81c49c610: 2023-02-09 16:56:03,301 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1675961761714.a74dd38f0f12c6469fa122f81c49c610. 2023-02-09 16:56:03,301 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 16:56:03,301 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 16:56:03,301 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:03,301 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-09 16:56:03,301 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-09 16:56:03,303 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:03,303 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:03,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:03,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:56:03,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:56:03,303 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:03,303 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:56:03,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:56:03,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:56:03,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:03,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:03,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:56:03,305 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-09 16:56:03,305 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-09 16:56:03,305 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@35d4d4ed[Count = 0] remaining members to acquire global barrier 2023-02-09 16:56:03,305 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:03,306 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:03,306 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:03,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:03,306 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-09 16:56:03,306 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:03,306 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:56:03,306 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-09 16:56:03,306 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:56:03,308 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:03,308 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-09 16:56:03,308 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:56:03,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:03,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:56:03,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:56:03,308 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-09 16:56:03,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:56:03,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:56:03,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:03,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:03,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:56:03,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:03,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:03,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:56:03,310 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-09 16:56:03,310 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-09 16:56:03,310 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:56:03,310 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:56:03,310 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:03,310 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:56:03,313 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:03,313 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:03,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:03,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:56:03,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:56:03,313 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:03,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:03,313 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:56:03,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:56:03,313 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:03,313 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:56:03,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:56:03,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:03,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:03,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:56:03,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:03,314 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:03,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:03,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:56:03,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:03,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:03,316 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:03,316 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:56:03,316 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:03,316 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:56:03,316 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:56:03,316 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:56:03,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:56:03,316 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-09 16:56:03,316 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:56:03,316 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:03,317 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:03,317 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:03,317 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:03,317 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:03,317 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 16:56:03,317 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:56:03,317 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:56:03,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:56:03,417 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:56:03,417 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:56:03,417 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:56:03,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:56:03,421 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:56:03,421 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:56:03,422 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:56:03,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 16:56:03,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:03,424 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-09 16:56:03,424 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:56:03,424 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-09 16:56:03,424 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-09 16:56:03,424 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:03,424 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:03,425 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:03,425 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:56:03,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:56:03,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:56:03,426 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:03,426 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:56:03,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:03,426 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:03,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:56:03,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:03,426 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:03,427 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-09 16:56:03,427 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:03,427 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-09 16:56:03,427 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:56:03,427 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-09 16:56:03,427 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 16:56:03,427 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:56:03,427 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1675961761714.a74dd38f0f12c6469fa122f81c49c610. 2023-02-09 16:56:03,427 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1675961761714.a74dd38f0f12c6469fa122f81c49c610. started... 2023-02-09 16:56:03,427 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing a74dd38f0f12c6469fa122f81c49c610 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-09 16:56:03,838 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511288f01a39dafce4e698e3dff4180e12aad to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511288f01a39dafce4e698e3dff4180e12aad 2023-02-09 16:56:04,243 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/.tmp/family1/c6082d91a3ac4e3eacf44ea5323b05f0 2023-02-09 16:56:04,247 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/.tmp/family1/c6082d91a3ac4e3eacf44ea5323b05f0 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/c6082d91a3ac4e3eacf44ea5323b05f0 2023-02-09 16:56:04,251 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/c6082d91a3ac4e3eacf44ea5323b05f0, entries=1, sequenceid=9, filesize=5.0 K 2023-02-09 16:56:04,252 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for a74dd38f0f12c6469fa122f81c49c610 in 825ms, sequenceid=9, compaction requested=false 2023-02-09 16:56:04,252 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for a74dd38f0f12c6469fa122f81c49c610: 2023-02-09 16:56:04,252 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1675961761714.a74dd38f0f12c6469fa122f81c49c610. 2023-02-09 16:56:04,252 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 16:56:04,252 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 16:56:04,252 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:04,252 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-09 16:56:04,252 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-09 16:56:04,253 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:04,253 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:04,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:04,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:56:04,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:56:04,254 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:04,254 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:56:04,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:56:04,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:56:04,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:04,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:04,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:56:04,255 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-09 16:56:04,255 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@19a9a71b[Count = 0] remaining members to acquire global barrier 2023-02-09 16:56:04,255 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-09 16:56:04,255 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:04,257 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:04,257 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:04,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:04,257 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-09 16:56:04,257 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-09 16:56:04,257 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:56:04,257 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:04,257 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:56:04,258 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-09 16:56:04,258 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:04,258 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:56:04,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:04,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:56:04,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:56:04,258 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-09 16:56:04,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:56:04,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:56:04,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:04,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:04,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:56:04,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:04,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:04,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:56:04,260 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-09 16:56:04,260 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-09 16:56:04,260 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:56:04,260 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:56:04,260 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:04,260 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:56:04,262 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:04,262 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:04,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:04,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:56:04,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:56:04,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:04,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:04,262 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:56:04,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:56:04,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:56:04,262 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:04,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:56:04,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:04,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:04,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:56:04,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:04,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:04,263 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:04,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:56:04,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:04,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:04,265 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:04,266 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:56:04,266 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:04,266 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:56:04,266 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:56:04,266 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:56:04,266 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-09 16:56:04,266 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:56:04,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:56:04,266 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:04,266 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:04,266 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:04,266 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:04,266 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:04,266 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 16:56:04,266 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:56:04,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:56:04,266 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:56:04,366 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:56:04,367 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:56:04,367 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:56:04,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:56:04,371 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:56:04,371 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:56:04,371 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:56:04,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 16:56:04,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:04,373 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-09 16:56:04,373 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:56:04,373 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-09 16:56:04,373 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-09 16:56:04,373 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:04,374 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:04,379 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:04,379 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:56:04,379 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:56:04,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:56:04,379 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:04,379 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:56:04,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:04,379 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:04,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:56:04,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:04,380 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:04,380 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-09 16:56:04,380 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:04,380 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-09 16:56:04,380 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:56:04,380 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-09 16:56:04,380 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 16:56:04,380 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:56:04,380 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1675961761714.a74dd38f0f12c6469fa122f81c49c610. 2023-02-09 16:56:04,380 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1675961761714.a74dd38f0f12c6469fa122f81c49c610. started... 2023-02-09 16:56:04,381 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing a74dd38f0f12c6469fa122f81c49c610 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 16:56:04,794 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512013af65511aca44bf6871702627ef3aeba to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512013af65511aca44bf6871702627ef3aeba 2023-02-09 16:56:05,199 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/.tmp/family1/51c91cf434a7489ba3080cb4e1da29ca 2023-02-09 16:56:05,203 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/.tmp/family1/51c91cf434a7489ba3080cb4e1da29ca as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/51c91cf434a7489ba3080cb4e1da29ca 2023-02-09 16:56:05,207 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/51c91cf434a7489ba3080cb4e1da29ca, entries=1, sequenceid=13, filesize=4.9 K 2023-02-09 16:56:05,208 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a74dd38f0f12c6469fa122f81c49c610 in 827ms, sequenceid=13, compaction requested=true 2023-02-09 16:56:05,209 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for a74dd38f0f12c6469fa122f81c49c610: 2023-02-09 16:56:05,209 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1675961761714.a74dd38f0f12c6469fa122f81c49c610. 2023-02-09 16:56:05,209 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 16:56:05,209 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 16:56:05,209 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:05,209 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-09 16:56:05,209 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-09 16:56:05,211 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:05,211 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:05,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:05,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:56:05,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:56:05,211 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:05,211 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:56:05,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:56:05,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:56:05,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:05,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:05,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:56:05,212 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-09 16:56:05,212 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2d690bae[Count = 0] remaining members to acquire global barrier 2023-02-09 16:56:05,212 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-09 16:56:05,212 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:05,213 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:05,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:05,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:05,213 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-09 16:56:05,214 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-09 16:56:05,214 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:56:05,214 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:05,214 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:56:05,215 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:05,215 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-09 16:56:05,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:05,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:56:05,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:56:05,215 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:56:05,215 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-09 16:56:05,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:56:05,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:56:05,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:05,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:05,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:56:05,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:05,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:05,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:56:05,217 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-09 16:56:05,217 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-09 16:56:05,217 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:56:05,217 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:56:05,217 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:05,217 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:56:05,220 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:05,220 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:05,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:05,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:56:05,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:56:05,220 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:05,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:05,220 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:56:05,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:56:05,220 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:56:05,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:56:05,220 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:05,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:05,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:05,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:56:05,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:05,221 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:05,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:05,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:56:05,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:05,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:05,223 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:05,223 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:05,224 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:56:05,224 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:56:05,224 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:56:05,224 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:56:05,224 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-09 16:56:05,224 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:56:05,224 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:05,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:56:05,224 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-09 16:56:05,224 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:05,224 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:05,224 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:05,224 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:05,224 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 16:56:05,224 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:56:05,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:56:05,224 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:56:05,325 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:56:05,325 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:56:05,325 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:56:05,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:56:05,329 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:56:05,329 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:56:05,329 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:56:05,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 16:56:05,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:05,331 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-09 16:56:05,331 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:56:05,331 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-09 16:56:05,331 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-09 16:56:05,331 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:05,331 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:05,333 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:05,333 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:56:05,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:56:05,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:56:05,333 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:05,333 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:56:05,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:05,333 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:05,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:56:05,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:05,334 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:05,334 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-09 16:56:05,334 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:05,334 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-09 16:56:05,334 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:56:05,334 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-09 16:56:05,334 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 16:56:05,334 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:56:05,334 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1675961761714.a74dd38f0f12c6469fa122f81c49c610. 2023-02-09 16:56:05,334 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1675961761714.a74dd38f0f12c6469fa122f81c49c610. started... 2023-02-09 16:56:05,334 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing a74dd38f0f12c6469fa122f81c49c610 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 16:56:05,354 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-09 16:56:05,354 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x48ee0a65 to 127.0.0.1:53887 2023-02-09 16:56:05,354 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 16:56:05,355 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-09 16:56:05,355 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1446083d to 127.0.0.1:53887 2023-02-09 16:56:05,355 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 16:56:05,355 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-09 16:56:05,355 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0df24af2 to 127.0.0.1:53887 2023-02-09 16:56:05,355 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 16:56:05,763 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512059033fcf13639438b995e2c1ebc455de4 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512059033fcf13639438b995e2c1ebc455de4 2023-02-09 16:56:06,168 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/.tmp/family1/4f851300294040e3ac697933a671a0b4 2023-02-09 16:56:06,172 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/.tmp/family1/4f851300294040e3ac697933a671a0b4 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/4f851300294040e3ac697933a671a0b4 2023-02-09 16:56:06,176 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/4f851300294040e3ac697933a671a0b4, entries=1, sequenceid=17, filesize=4.9 K 2023-02-09 16:56:06,177 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a74dd38f0f12c6469fa122f81c49c610 in 843ms, sequenceid=17, compaction requested=true 2023-02-09 16:56:06,177 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for a74dd38f0f12c6469fa122f81c49c610: 2023-02-09 16:56:06,177 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1675961761714.a74dd38f0f12c6469fa122f81c49c610. 2023-02-09 16:56:06,177 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 16:56:06,177 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 16:56:06,177 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:06,177 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-09 16:56:06,177 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-09 16:56:06,179 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:06,179 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:06,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:06,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:56:06,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:56:06,179 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:06,179 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:56:06,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:56:06,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:56:06,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:06,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:06,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:56:06,180 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-09 16:56:06,180 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6690fcc2[Count = 0] remaining members to acquire global barrier 2023-02-09 16:56:06,180 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-09 16:56:06,180 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:06,182 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:06,182 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:06,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:06,182 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-09 16:56:06,182 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-09 16:56:06,182 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:06,182 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:56:06,182 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:56:06,184 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-09 16:56:06,184 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:06,184 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:56:06,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:06,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:56:06,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:56:06,184 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-09 16:56:06,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:56:06,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:56:06,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:06,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:06,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:56:06,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:06,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:06,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:56:06,186 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-09 16:56:06,186 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-09 16:56:06,186 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:56:06,186 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:56:06,186 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:06,186 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:56:06,188 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:06,188 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:06,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:06,188 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:06,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:56:06,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:56:06,188 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:56:06,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:06,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:56:06,188 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:56:06,188 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:06,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:56:06,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:06,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:06,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:56:06,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:06,189 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:06,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:06,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:56:06,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:06,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:06,192 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:06,192 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:56:06,192 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:06,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:56:06,192 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-09 16:56:06,192 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:06,192 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-09 16:56:06,192 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:56:06,192 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:56:06,192 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:56:06,192 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:06,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:56:06,192 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:06,192 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:06,192 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:06,192 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 16:56:06,192 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:56:06,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:56:06,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:56:06,293 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:56:06,293 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:56:06,293 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:56:06,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:56:06,296 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:56:06,297 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:56:06,297 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:56:06,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 16:56:06,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:06,299 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-09 16:56:06,299 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:56:06,299 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-09 16:56:06,299 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-09 16:56:06,299 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:06,299 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:06,300 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:06,300 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:56:06,300 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:56:06,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:56:06,300 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:06,300 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:56:06,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:06,301 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:06,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:56:06,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:06,301 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:06,301 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-09 16:56:06,302 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:06,302 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-09 16:56:06,302 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:56:06,302 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-09 16:56:06,302 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 16:56:06,302 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:56:06,302 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1675961761714.a74dd38f0f12c6469fa122f81c49c610. 2023-02-09 16:56:06,302 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1675961761714.a74dd38f0f12c6469fa122f81c49c610. started... 2023-02-09 16:56:06,302 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing a74dd38f0f12c6469fa122f81c49c610 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 16:56:06,712 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228f0bbdf588a074fe0bf21c7c13a178255 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228f0bbdf588a074fe0bf21c7c13a178255 2023-02-09 16:56:07,117 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/.tmp/family1/4b540a03bf4c4c8583ede8ce1a74c7d6 2023-02-09 16:56:07,121 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/.tmp/family1/4b540a03bf4c4c8583ede8ce1a74c7d6 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/4b540a03bf4c4c8583ede8ce1a74c7d6 2023-02-09 16:56:07,124 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/4b540a03bf4c4c8583ede8ce1a74c7d6, entries=1, sequenceid=21, filesize=4.9 K 2023-02-09 16:56:07,125 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a74dd38f0f12c6469fa122f81c49c610 in 823ms, sequenceid=21, compaction requested=true 2023-02-09 16:56:07,125 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for a74dd38f0f12c6469fa122f81c49c610: 2023-02-09 16:56:07,125 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1675961761714.a74dd38f0f12c6469fa122f81c49c610. 2023-02-09 16:56:07,125 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 16:56:07,125 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 16:56:07,125 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:07,125 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-09 16:56:07,125 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-09 16:56:07,127 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:07,127 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:07,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:07,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:56:07,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:56:07,127 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:07,128 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:56:07,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:56:07,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:56:07,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:07,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:07,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:56:07,129 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-09 16:56:07,129 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@75f03f41[Count = 0] remaining members to acquire global barrier 2023-02-09 16:56:07,129 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-09 16:56:07,129 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:07,130 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:07,130 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:07,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:07,130 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-09 16:56:07,130 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-09 16:56:07,130 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:56:07,130 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:07,130 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:56:07,131 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-09 16:56:07,131 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:56:07,131 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:07,131 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-09 16:56:07,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:07,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:56:07,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:56:07,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:56:07,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:56:07,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:07,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:07,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:56:07,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:07,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:07,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:56:07,133 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-09 16:56:07,133 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-09 16:56:07,133 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:56:07,133 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:56:07,134 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:07,134 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:56:07,135 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:07,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:07,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:56:07,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:56:07,135 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:07,135 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:56:07,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:07,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:07,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:56:07,135 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:07,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:56:07,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:56:07,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:07,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:07,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:56:07,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:07,136 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:07,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:07,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:56:07,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:07,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:07,141 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:07,141 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:56:07,141 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:07,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:56:07,141 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:07,141 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-09 16:56:07,141 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:56:07,141 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:56:07,141 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:07,142 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-09 16:56:07,141 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:56:07,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:56:07,142 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 16:56:07,142 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:07,142 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:56:07,142 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:07,142 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:07,142 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:56:07,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:56:07,242 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:56:07,242 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:56:07,242 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:56:07,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:56:07,246 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:56:07,246 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:56:07,247 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:56:07,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 16:56:07,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:07,248 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-09 16:56:07,248 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:56:07,248 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-09 16:56:07,248 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-09 16:56:07,249 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:07,249 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:07,250 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:07,250 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:56:07,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:56:07,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:56:07,250 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:07,250 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:56:07,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:07,251 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:07,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:56:07,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:07,251 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:07,251 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-09 16:56:07,251 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:07,251 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-09 16:56:07,251 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:56:07,251 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-09 16:56:07,252 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 16:56:07,252 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:56:07,252 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1675961761714.a74dd38f0f12c6469fa122f81c49c610. 2023-02-09 16:56:07,252 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1675961761714.a74dd38f0f12c6469fa122f81c49c610. started... 2023-02-09 16:56:07,252 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing a74dd38f0f12c6469fa122f81c49c610 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 16:56:07,662 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231a4167492811e4a5fbfdbd9b5575f55ea to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231a4167492811e4a5fbfdbd9b5575f55ea 2023-02-09 16:56:08,004 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-09 16:56:08,067 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/.tmp/family1/e743e6d8d3c74182bd4acd219f2325af 2023-02-09 16:56:08,071 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/.tmp/family1/e743e6d8d3c74182bd4acd219f2325af as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/e743e6d8d3c74182bd4acd219f2325af 2023-02-09 16:56:08,075 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/e743e6d8d3c74182bd4acd219f2325af, entries=1, sequenceid=25, filesize=4.9 K 2023-02-09 16:56:08,075 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a74dd38f0f12c6469fa122f81c49c610 in 823ms, sequenceid=25, compaction requested=true 2023-02-09 16:56:08,076 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for a74dd38f0f12c6469fa122f81c49c610: 2023-02-09 16:56:08,076 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1675961761714.a74dd38f0f12c6469fa122f81c49c610. 2023-02-09 16:56:08,076 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 16:56:08,076 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 16:56:08,076 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:08,076 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-09 16:56:08,076 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-09 16:56:08,077 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:08,077 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:08,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:08,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:56:08,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:56:08,077 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:08,078 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:56:08,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:56:08,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:56:08,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:08,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:08,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:56:08,079 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-09 16:56:08,079 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2135df9b[Count = 0] remaining members to acquire global barrier 2023-02-09 16:56:08,079 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-09 16:56:08,079 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:08,080 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:08,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:08,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:08,080 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-09 16:56:08,080 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-09 16:56:08,080 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:56:08,080 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:08,080 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:56:08,082 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-09 16:56:08,082 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:56:08,082 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:08,082 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-09 16:56:08,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:08,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:56:08,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:56:08,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:56:08,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:56:08,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:08,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:08,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:56:08,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:08,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:08,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:56:08,084 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-09 16:56:08,084 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-09 16:56:08,085 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:56:08,085 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:56:08,085 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:08,085 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:56:08,086 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:08,086 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:08,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:08,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:56:08,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:08,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:08,086 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:56:08,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:56:08,086 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:08,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:56:08,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:56:08,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:56:08,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:08,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:08,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:56:08,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:08,087 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:08,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:08,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:56:08,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:08,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:08,089 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:08,089 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:56:08,090 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:08,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:56:08,090 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:56:08,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:56:08,090 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:56:08,090 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-09 16:56:08,090 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-09 16:56:08,090 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:56:08,090 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:08,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:56:08,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:56:08,090 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:08,090 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:08,090 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:08,090 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:08,090 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 16:56:08,090 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:56:08,191 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:56:08,191 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:56:08,191 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:56:08,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:56:08,195 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:56:08,195 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:56:08,195 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:56:08,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 16:56:08,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:08,197 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-09 16:56:08,197 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:56:08,197 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-09 16:56:08,197 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-09 16:56:08,197 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:08,197 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:08,198 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:56:08,198 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:08,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:56:08,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:56:08,199 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:08,199 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:56:08,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:08,199 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:08,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:56:08,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:08,199 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:08,200 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-09 16:56:08,200 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:08,200 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-09 16:56:08,200 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:56:08,200 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-09 16:56:08,200 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 16:56:08,200 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:56:08,200 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1675961761714.a74dd38f0f12c6469fa122f81c49c610. 2023-02-09 16:56:08,200 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1675961761714.a74dd38f0f12c6469fa122f81c49c610. started... 2023-02-09 16:56:08,200 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing a74dd38f0f12c6469fa122f81c49c610 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 16:56:08,610 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601017ec4a728d21d439883723b5fd5005233 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601017ec4a728d21d439883723b5fd5005233 2023-02-09 16:56:09,015 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/.tmp/family1/1bf7f837a44140aaa96713911477adba 2023-02-09 16:56:09,019 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/.tmp/family1/1bf7f837a44140aaa96713911477adba as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/1bf7f837a44140aaa96713911477adba 2023-02-09 16:56:09,023 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/1bf7f837a44140aaa96713911477adba, entries=1, sequenceid=29, filesize=4.9 K 2023-02-09 16:56:09,023 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a74dd38f0f12c6469fa122f81c49c610 in 823ms, sequenceid=29, compaction requested=true 2023-02-09 16:56:09,024 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for a74dd38f0f12c6469fa122f81c49c610: 2023-02-09 16:56:09,024 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1675961761714.a74dd38f0f12c6469fa122f81c49c610. 2023-02-09 16:56:09,024 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 16:56:09,024 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 16:56:09,024 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:09,024 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-09 16:56:09,024 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-09 16:56:09,026 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:09,026 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:09,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:09,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:56:09,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:56:09,027 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:09,027 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:56:09,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:56:09,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:56:09,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:09,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:09,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:56:09,028 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-09 16:56:09,028 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@44649468[Count = 0] remaining members to acquire global barrier 2023-02-09 16:56:09,028 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-09 16:56:09,028 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:09,029 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:09,029 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:09,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:09,029 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-09 16:56:09,029 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-09 16:56:09,029 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:09,029 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:56:09,029 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:56:09,030 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-09 16:56:09,030 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:09,030 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:56:09,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:09,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:56:09,030 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-09 16:56:09,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:56:09,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:56:09,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:56:09,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:09,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:09,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:56:09,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:09,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:09,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:56:09,032 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-09 16:56:09,032 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-09 16:56:09,033 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:56:09,033 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:56:09,033 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:09,033 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:56:09,034 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:09,034 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:09,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:09,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:56:09,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:56:09,034 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:09,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:09,034 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:56:09,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:56:09,034 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:56:09,034 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:09,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:56:09,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:09,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:09,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:56:09,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:09,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:09,036 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:09,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:56:09,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:09,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:09,038 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:09,038 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:09,038 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:56:09,038 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-09 16:56:09,039 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:56:09,038 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:56:09,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:56:09,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:56:09,038 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:56:09,038 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:09,039 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 16:56:09,039 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:09,039 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:56:09,039 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:56:09,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:56:09,039 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:09,039 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:09,039 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:09,139 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:56:09,139 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:56:09,139 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:56:09,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:56:09,143 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:56:09,143 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:56:09,144 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:56:09,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 16:56:09,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:09,145 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-09 16:56:09,145 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:56:09,145 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-09 16:56:09,145 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-09 16:56:09,146 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:09,146 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:09,147 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:09,147 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:56:09,147 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:56:09,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:56:09,147 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:09,147 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:56:09,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:09,147 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:09,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:56:09,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:09,148 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:09,148 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-09 16:56:09,148 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:09,148 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-09 16:56:09,148 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:56:09,148 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-09 16:56:09,148 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 16:56:09,148 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:56:09,148 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1675961761714.a74dd38f0f12c6469fa122f81c49c610. 2023-02-09 16:56:09,148 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1675961761714.a74dd38f0f12c6469fa122f81c49c610. started... 2023-02-09 16:56:09,148 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing a74dd38f0f12c6469fa122f81c49c610 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 16:56:09,559 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010340dfd0a268ed49fca6225d3321de16f0 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2016010340dfd0a268ed49fca6225d3321de16f0 2023-02-09 16:56:09,964 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/.tmp/family1/1065867c2cd54722b07381e59f2d0ced 2023-02-09 16:56:09,967 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/.tmp/family1/1065867c2cd54722b07381e59f2d0ced as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/1065867c2cd54722b07381e59f2d0ced 2023-02-09 16:56:09,970 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/1065867c2cd54722b07381e59f2d0ced, entries=1, sequenceid=33, filesize=4.9 K 2023-02-09 16:56:09,971 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a74dd38f0f12c6469fa122f81c49c610 in 823ms, sequenceid=33, compaction requested=true 2023-02-09 16:56:09,971 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for a74dd38f0f12c6469fa122f81c49c610: 2023-02-09 16:56:09,971 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1675961761714.a74dd38f0f12c6469fa122f81c49c610. 2023-02-09 16:56:09,971 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 16:56:09,971 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 16:56:09,971 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:09,971 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-09 16:56:09,971 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-09 16:56:09,972 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:09,972 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:09,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:09,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:56:09,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:56:09,973 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:09,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:56:09,973 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:56:09,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:56:09,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:09,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:09,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:56:09,974 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-09 16:56:09,974 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@25f306ca[Count = 0] remaining members to acquire global barrier 2023-02-09 16:56:09,974 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-09 16:56:09,974 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:09,975 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:09,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:09,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:09,975 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-09 16:56:09,975 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-09 16:56:09,975 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:09,975 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:56:09,975 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:56:09,978 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-09 16:56:09,978 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:56:09,978 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:09,978 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-09 16:56:09,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:09,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:56:09,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:56:09,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:56:09,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:56:09,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:09,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:09,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:56:09,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:09,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:09,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:56:09,980 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-09 16:56:09,980 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-09 16:56:09,980 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:56:09,980 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:56:09,980 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:09,980 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:56:09,983 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:09,983 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:09,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:09,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:56:09,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:56:09,984 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:09,983 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:56:09,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:09,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:56:09,984 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:09,984 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:56:09,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:56:09,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:09,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:09,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:56:09,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:09,985 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:09,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:09,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:56:09,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:09,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:09,987 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:09,987 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:56:09,987 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:09,987 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:56:09,987 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:56:09,987 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-09 16:56:09,987 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:56:09,987 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:09,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:56:09,987 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:09,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:56:09,987 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:09,987 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:09,987 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:09,987 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 16:56:09,987 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:56:09,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:56:09,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:56:10,088 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:56:10,088 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:56:10,088 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:56:10,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:56:10,091 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:56:10,092 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:56:10,092 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:56:10,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 16:56:10,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:10,093 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-09 16:56:10,093 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:56:10,094 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-09 16:56:10,094 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-09 16:56:10,094 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:10,094 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:10,095 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:10,095 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:56:10,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:56:10,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:56:10,095 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:10,095 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:56:10,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:10,096 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:10,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:56:10,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:10,096 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:10,096 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-09 16:56:10,096 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:10,096 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-09 16:56:10,096 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:56:10,096 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-09 16:56:10,097 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 16:56:10,097 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:56:10,097 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1675961761714.a74dd38f0f12c6469fa122f81c49c610. 2023-02-09 16:56:10,097 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1675961761714.a74dd38f0f12c6469fa122f81c49c610. started... 2023-02-09 16:56:10,097 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing a74dd38f0f12c6469fa122f81c49c610 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 16:56:10,509 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907680835782b9948dab8f7daadf68284e1 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20150907680835782b9948dab8f7daadf68284e1 2023-02-09 16:56:10,914 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/.tmp/family1/04eccd6e7c1f4bb2a2a55d542f5cb702 2023-02-09 16:56:10,919 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/.tmp/family1/04eccd6e7c1f4bb2a2a55d542f5cb702 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/04eccd6e7c1f4bb2a2a55d542f5cb702 2023-02-09 16:56:10,922 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/04eccd6e7c1f4bb2a2a55d542f5cb702, entries=1, sequenceid=37, filesize=4.9 K 2023-02-09 16:56:10,923 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a74dd38f0f12c6469fa122f81c49c610 in 826ms, sequenceid=37, compaction requested=true 2023-02-09 16:56:10,923 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for a74dd38f0f12c6469fa122f81c49c610: 2023-02-09 16:56:10,923 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1675961761714.a74dd38f0f12c6469fa122f81c49c610. 2023-02-09 16:56:10,923 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 16:56:10,923 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 16:56:10,923 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:10,923 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-09 16:56:10,923 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-09 16:56:10,927 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:10,927 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:10,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:10,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:56:10,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:56:10,928 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:10,928 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:56:10,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:56:10,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:56:10,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:10,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:10,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:56:10,929 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-09 16:56:10,929 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@510d2f02[Count = 0] remaining members to acquire global barrier 2023-02-09 16:56:10,929 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-09 16:56:10,929 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:10,930 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:10,930 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:10,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:10,930 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-09 16:56:10,930 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-09 16:56:10,930 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:56:10,930 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:10,930 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:56:10,931 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-09 16:56:10,931 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:10,931 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:56:10,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:10,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:56:10,931 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-09 16:56:10,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:56:10,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:56:10,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:56:10,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:10,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:10,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:56:10,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:10,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:10,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:56:10,934 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-09 16:56:10,934 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-09 16:56:10,934 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:56:10,934 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:56:10,934 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:10,934 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:56:10,935 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:10,935 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:10,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:10,935 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:56:10,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:56:10,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:56:10,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:10,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:10,935 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:10,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:56:10,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:56:10,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:56:10,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:10,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:10,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:56:10,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:10,936 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:10,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:10,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:56:10,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:10,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:10,939 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:56:10,939 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:56:10,939 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:56:10,939 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:10,939 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:56:10,939 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-09 16:56:10,939 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:56:10,939 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:10,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:56:10,939 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:10,939 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:10,939 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-09 16:56:10,939 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:10,940 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 16:56:10,940 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:56:10,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:56:10,940 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:10,940 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:56:10,940 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:11,040 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:56:11,040 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:56:11,040 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:56:11,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:56:11,044 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:56:11,044 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:56:11,044 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:56:11,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 16:56:11,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:11,046 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-09 16:56:11,046 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:56:11,046 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-09 16:56:11,046 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-09 16:56:11,046 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:11,046 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:11,047 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:56:11,047 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:11,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:56:11,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:56:11,048 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:11,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:11,048 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:56:11,048 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:11,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:56:11,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:11,049 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:11,049 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-09 16:56:11,049 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:11,049 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-09 16:56:11,049 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:56:11,049 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-09 16:56:11,049 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 16:56:11,049 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:56:11,049 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1675961761714.a74dd38f0f12c6469fa122f81c49c610. 2023-02-09 16:56:11,049 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1675961761714.a74dd38f0f12c6469fa122f81c49c610. started... 2023-02-09 16:56:11,049 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing a74dd38f0f12c6469fa122f81c49c610 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 16:56:11,460 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511204d559f0ead8544658452914e4b6b3d0e to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511204d559f0ead8544658452914e4b6b3d0e 2023-02-09 16:56:11,866 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/.tmp/family1/5710fb688eed4cb3bb3eb8f09f9bfd64 2023-02-09 16:56:11,870 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/.tmp/family1/5710fb688eed4cb3bb3eb8f09f9bfd64 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/5710fb688eed4cb3bb3eb8f09f9bfd64 2023-02-09 16:56:11,873 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/5710fb688eed4cb3bb3eb8f09f9bfd64, entries=1, sequenceid=41, filesize=4.9 K 2023-02-09 16:56:11,874 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a74dd38f0f12c6469fa122f81c49c610 in 825ms, sequenceid=41, compaction requested=true 2023-02-09 16:56:11,874 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for a74dd38f0f12c6469fa122f81c49c610: 2023-02-09 16:56:11,874 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1675961761714.a74dd38f0f12c6469fa122f81c49c610. 2023-02-09 16:56:11,874 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 16:56:11,874 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 16:56:11,874 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:11,874 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-09 16:56:11,874 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-09 16:56:11,875 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:11,875 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:11,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:11,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:56:11,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:56:11,876 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:11,876 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:56:11,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:56:11,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:56:11,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:11,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:11,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:56:11,877 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-09 16:56:11,877 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5e4bebbf[Count = 0] remaining members to acquire global barrier 2023-02-09 16:56:11,877 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-09 16:56:11,877 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:11,878 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:11,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:11,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:11,878 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-09 16:56:11,878 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:11,878 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:56:11,878 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-09 16:56:11,878 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:56:11,884 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-09 16:56:11,884 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:11,885 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:56:11,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:11,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:56:11,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:56:11,885 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-09 16:56:11,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:56:11,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:56:11,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:11,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:11,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:56:11,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:11,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:11,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:56:11,887 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-09 16:56:11,887 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-09 16:56:11,887 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:56:11,887 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:56:11,887 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:11,887 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:56:11,888 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:11,888 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:11,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:11,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:56:11,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:56:11,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:11,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:11,888 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:56:11,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:56:11,888 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:11,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:56:11,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:56:11,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:11,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:11,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:56:11,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:11,889 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:11,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:11,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:56:11,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:11,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:11,891 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:56:11,891 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:56:11,891 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:56:11,891 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:11,891 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-09 16:56:11,891 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:56:11,891 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:56:11,892 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-09 16:56:11,891 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:11,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:56:11,892 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:11,892 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:11,892 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 16:56:11,892 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:56:11,892 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:11,892 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:56:11,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:56:11,892 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:11,892 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:11,992 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:56:11,992 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:56:11,992 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:56:11,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:56:11,994 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41333] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMinorCompactionWithMonthlyPolicy 2023-02-09 16:56:11,995 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] procedure2.ProcedureExecutor(1029): Stored pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-09 16:56:11,996 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-09 16:56:11,997 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 16:56:11,997 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=115, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675962371997 2023-02-09 16:56:11,999 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-09 16:56:11,999 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMinorCompactionWithMonthlyPolicy' and column 'family1' 2023-02-09 16:56:12,000 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-09 16:56:12,000 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] zookeeper.ReadOnlyZKClient(139): Connect 0x2c41fa5d to 127.0.0.1:53887 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 16:56:12,004 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@57aa3f7f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 16:56:12,004 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-09 16:56:12,448 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103704b9f6d262e4cf98a7708b10625a155 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103704b9f6d262e4cf98a7708b10625a155 2023-02-09 16:56:12,449 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-09 16:56:12,464 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 16:56:12,467 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52474, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 16:56:12,471 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:56:12,471 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:56:12,472 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-09 16:56:12,473 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39526, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-09 16:56:12,480 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/f516434872ef4753bebcae2475e3c1e9 first=Optional[r5] last=Optional[r6] 2023-02-09 16:56:12,480 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1675961761714.a74dd38f0f12c6469fa122f81c49c610., hostname=jenkins-hbase4.apache.org,35511,1675961620699, seqNum=2 for row with hfile group [{family1,hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/f516434872ef4753bebcae2475e3c1e9}] 2023-02-09 16:56:12,484 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.HStore(763): Validating hfile at hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/f516434872ef4753bebcae2475e3c1e9 for inclusion in a74dd38f0f12c6469fa122f81c49c610/family1 2023-02-09 16:56:12,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-02-09 16:56:12,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.HStore(777): Region bounds: first= last= 2023-02-09 16:56:12,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.HRegion(2445): Flush status journal for a74dd38f0f12c6469fa122f81c49c610: 2023-02-09 16:56:12,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/f516434872ef4753bebcae2475e3c1e9 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMinorCompactionWithMonthlyPolicy__91ha5ogg4sg8g1lfc9e8u95vi3t4qsa3sib8rti3u8nr1hra6112v3odt9pcki6r/family1/f516434872ef4753bebcae2475e3c1e9 2023-02-09 16:56:12,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMinorCompactionWithMonthlyPolicy__91ha5ogg4sg8g1lfc9e8u95vi3t4qsa3sib8rti3u8nr1hra6112v3odt9pcki6r/family1/f516434872ef4753bebcae2475e3c1e9 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/efd19ff0a3bd4d28b088ce33bc4e228b_SeqId_44_ 2023-02-09 16:56:12,489 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.HStore(849): Loaded HFile hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMinorCompactionWithMonthlyPolicy__91ha5ogg4sg8g1lfc9e8u95vi3t4qsa3sib8rti3u8nr1hra6112v3odt9pcki6r/family1/f516434872ef4753bebcae2475e3c1e9 into a74dd38f0f12c6469fa122f81c49c610/family1 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/efd19ff0a3bd4d28b088ce33bc4e228b_SeqId_44_ - updating store file list. 2023-02-09 16:56:12,492 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.HStore(882): Loaded HFile hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/efd19ff0a3bd4d28b088ce33bc4e228b_SeqId_44_ into a74dd38f0f12c6469fa122f81c49c610/family1 2023-02-09 16:56:12,492 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.HStore(855): Successfully loaded hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMinorCompactionWithMonthlyPolicy__91ha5ogg4sg8g1lfc9e8u95vi3t4qsa3sib8rti3u8nr1hra6112v3odt9pcki6r/family1/f516434872ef4753bebcae2475e3c1e9 into a74dd38f0f12c6469fa122f81c49c610/family1 (new location: hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/efd19ff0a3bd4d28b088ce33bc4e228b_SeqId_44_) 2023-02-09 16:56:12,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMinorCompactionWithMonthlyPolicy__91ha5ogg4sg8g1lfc9e8u95vi3t4qsa3sib8rti3u8nr1hra6112v3odt9pcki6r/family1/f516434872ef4753bebcae2475e3c1e9 2023-02-09 16:56:12,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-09 16:56:12,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-09 16:56:12,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.HStore(1912): a74dd38f0f12c6469fa122f81c49c610/family1 is initiating minor compaction 2023-02-09 16:56:12,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@5b2a40c4; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 16:56:12,495 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of a74dd38f0f12c6469fa122f81c49c610/family1 in testMinorCompactionWithMonthlyPolicy,,1675961761714.a74dd38f0f12c6469fa122f81c49c610. 2023-02-09 16:56:12,496 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/c6082d91a3ac4e3eacf44ea5323b05f0, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/51c91cf434a7489ba3080cb4e1da29ca, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/4f851300294040e3ac697933a671a0b4, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/4b540a03bf4c4c8583ede8ce1a74c7d6, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/e743e6d8d3c74182bd4acd219f2325af, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/1bf7f837a44140aaa96713911477adba, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/1065867c2cd54722b07381e59f2d0ced, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/04eccd6e7c1f4bb2a2a55d542f5cb702, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/5710fb688eed4cb3bb3eb8f09f9bfd64, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/efd19ff0a3bd4d28b088ce33bc4e228b_SeqId_44_] into tmpdir=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/.tmp, totalSize=49.7 K 2023-02-09 16:56:12,496 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting c6082d91a3ac4e3eacf44ea5323b05f0, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-09 16:56:12,496 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting 51c91cf434a7489ba3080cb4e1da29ca, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-09 16:56:12,496 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting 4f851300294040e3ac697933a671a0b4, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-09 16:56:12,496 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting 4b540a03bf4c4c8583ede8ce1a74c7d6, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-09 16:56:12,496 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting e743e6d8d3c74182bd4acd219f2325af, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-09 16:56:12,496 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting 1bf7f837a44140aaa96713911477adba, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-09 16:56:12,496 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting 1065867c2cd54722b07381e59f2d0ced, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-09 16:56:12,496 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting 04eccd6e7c1f4bb2a2a55d542f5cb702, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-09 16:56:12,496 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting 5710fb688eed4cb3bb3eb8f09f9bfd64, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-09 16:56:12,496 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting efd19ff0a3bd4d28b088ce33bc4e228b_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-09 16:56:12,497 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-09 16:56:12,498 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 16:56:12,499 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601017ec4a728d21d439883723b5fd5005233 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601017ec4a728d21d439883723b5fd5005233 2023-02-09 16:56:12,500 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2016010340dfd0a268ed49fca6225d3321de16f0 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2016010340dfd0a268ed49fca6225d3321de16f0 2023-02-09 16:56:12,500 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-02-09 16:56:12,500 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-02-09 16:56:12,501 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-09 16:56:12,501 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-09 16:56:12,527 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] throttle.PressureAwareThroughputController(145): a74dd38f0f12c6469fa122f81c49c610#family1#compaction#166 average throughput is 1.37 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 16:56:12,958 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/.tmp/family1/d018cffb937b4d3a8b29d2b96933218b as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/d018cffb937b4d3a8b29d2b96933218b 2023-02-09 16:56:12,960 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512313f969bb9bf7245a9823c03fb7fe7fc6c to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512313f969bb9bf7245a9823c03fb7fe7fc6c 2023-02-09 16:56:12,961 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-09 16:56:12,962 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in a74dd38f0f12c6469fa122f81c49c610/family1 of a74dd38f0f12c6469fa122f81c49c610 into d018cffb937b4d3a8b29d2b96933218b(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-09 16:56:12,962 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for a74dd38f0f12c6469fa122f81c49c610: 2023-02-09 16:56:12,963 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1675961761714.a74dd38f0f12c6469fa122f81c49c610., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1675961772495; duration=0sec 2023-02-09 16:56:12,963 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 16:56:12,977 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:56:12,977 INFO [MobCompactor-pool-0] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:56:12,984 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/e1cd2749f4f343c889aca93bcbcbf0a7 first=Optional[r1] last=Optional[r4] 2023-02-09 16:56:12,985 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1675961761714.a74dd38f0f12c6469fa122f81c49c610., hostname=jenkins-hbase4.apache.org,35511,1675961620699, seqNum=2 for row with hfile group [{family1,hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/e1cd2749f4f343c889aca93bcbcbf0a7}] 2023-02-09 16:56:12,987 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.HStore(763): Validating hfile at hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/e1cd2749f4f343c889aca93bcbcbf0a7 for inclusion in a74dd38f0f12c6469fa122f81c49c610/family1 2023-02-09 16:56:12,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-02-09 16:56:12,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.HStore(777): Region bounds: first= last= 2023-02-09 16:56:12,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.HRegion(2445): Flush status journal for a74dd38f0f12c6469fa122f81c49c610: 2023-02-09 16:56:12,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/e1cd2749f4f343c889aca93bcbcbf0a7 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMinorCompactionWithMonthlyPolicy__3eqdbapetp28ah8h3c11tecvv232hl6a0m90gscu0bbnqkrk9df5nlaj3f2tq7vb/family1/e1cd2749f4f343c889aca93bcbcbf0a7 2023-02-09 16:56:12,991 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/c6082d91a3ac4e3eacf44ea5323b05f0, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/51c91cf434a7489ba3080cb4e1da29ca, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/4f851300294040e3ac697933a671a0b4, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/4b540a03bf4c4c8583ede8ce1a74c7d6, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/e743e6d8d3c74182bd4acd219f2325af, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/1bf7f837a44140aaa96713911477adba, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/1065867c2cd54722b07381e59f2d0ced, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/04eccd6e7c1f4bb2a2a55d542f5cb702, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/5710fb688eed4cb3bb3eb8f09f9bfd64, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/efd19ff0a3bd4d28b088ce33bc4e228b_SeqId_44_] to archive 2023-02-09 16:56:12,991 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 16:56:12,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMinorCompactionWithMonthlyPolicy__3eqdbapetp28ah8h3c11tecvv232hl6a0m90gscu0bbnqkrk9df5nlaj3f2tq7vb/family1/e1cd2749f4f343c889aca93bcbcbf0a7 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/4819afd09b034c8eaa3f0538143ded85_SeqId_47_ 2023-02-09 16:56:12,993 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.HStore(849): Loaded HFile hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMinorCompactionWithMonthlyPolicy__3eqdbapetp28ah8h3c11tecvv232hl6a0m90gscu0bbnqkrk9df5nlaj3f2tq7vb/family1/e1cd2749f4f343c889aca93bcbcbf0a7 into a74dd38f0f12c6469fa122f81c49c610/family1 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/4819afd09b034c8eaa3f0538143ded85_SeqId_47_ - updating store file list. 2023-02-09 16:56:12,993 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/c6082d91a3ac4e3eacf44ea5323b05f0 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/c6082d91a3ac4e3eacf44ea5323b05f0 2023-02-09 16:56:12,994 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/51c91cf434a7489ba3080cb4e1da29ca to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/51c91cf434a7489ba3080cb4e1da29ca 2023-02-09 16:56:12,995 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/4f851300294040e3ac697933a671a0b4 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/4f851300294040e3ac697933a671a0b4 2023-02-09 16:56:12,996 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.HStore(882): Loaded HFile hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/4819afd09b034c8eaa3f0538143ded85_SeqId_47_ into a74dd38f0f12c6469fa122f81c49c610/family1 2023-02-09 16:56:12,996 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.HStore(855): Successfully loaded hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMinorCompactionWithMonthlyPolicy__3eqdbapetp28ah8h3c11tecvv232hl6a0m90gscu0bbnqkrk9df5nlaj3f2tq7vb/family1/e1cd2749f4f343c889aca93bcbcbf0a7 into a74dd38f0f12c6469fa122f81c49c610/family1 (new location: hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/4819afd09b034c8eaa3f0538143ded85_SeqId_47_) 2023-02-09 16:56:12,996 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/4b540a03bf4c4c8583ede8ce1a74c7d6 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/4b540a03bf4c4c8583ede8ce1a74c7d6 2023-02-09 16:56:12,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMinorCompactionWithMonthlyPolicy__3eqdbapetp28ah8h3c11tecvv232hl6a0m90gscu0bbnqkrk9df5nlaj3f2tq7vb/family1/e1cd2749f4f343c889aca93bcbcbf0a7 2023-02-09 16:56:12,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-09 16:56:12,997 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/e743e6d8d3c74182bd4acd219f2325af to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/e743e6d8d3c74182bd4acd219f2325af 2023-02-09 16:56:12,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-09 16:56:12,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.HStore(1912): a74dd38f0f12c6469fa122f81c49c610/family1 is initiating minor compaction (all files) 2023-02-09 16:56:12,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@3651eb8d; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 16:56:12,998 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of a74dd38f0f12c6469fa122f81c49c610/family1 in testMinorCompactionWithMonthlyPolicy,,1675961761714.a74dd38f0f12c6469fa122f81c49c610. 2023-02-09 16:56:12,998 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/3c45efdb39314b8ab6c8aef33fac5a73, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/d018cffb937b4d3a8b29d2b96933218b, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/4819afd09b034c8eaa3f0538143ded85_SeqId_47_] into tmpdir=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/.tmp, totalSize=178.1 K 2023-02-09 16:56:12,998 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting 3c45efdb39314b8ab6c8aef33fac5a73, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878845085 2023-02-09 16:56:12,999 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/1bf7f837a44140aaa96713911477adba to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/1bf7f837a44140aaa96713911477adba 2023-02-09 16:56:12,999 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting d018cffb937b4d3a8b29d2b96933218b, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621245085 2023-02-09 16:56:12,999 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] compactions.Compactor(207): Compacting 4819afd09b034c8eaa3f0538143ded85_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965245085 2023-02-09 16:56:13,000 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-09 16:56:13,000 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/1065867c2cd54722b07381e59f2d0ced to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/1065867c2cd54722b07381e59f2d0ced 2023-02-09 16:56:13,001 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 16:56:13,001 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/04eccd6e7c1f4bb2a2a55d542f5cb702 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/04eccd6e7c1f4bb2a2a55d542f5cb702 2023-02-09 16:56:13,002 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512013af65511aca44bf6871702627ef3aeba to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512013af65511aca44bf6871702627ef3aeba 2023-02-09 16:56:13,003 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/5710fb688eed4cb3bb3eb8f09f9bfd64 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/5710fb688eed4cb3bb3eb8f09f9bfd64 2023-02-09 16:56:13,003 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512059033fcf13639438b995e2c1ebc455de4 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512059033fcf13639438b995e2c1ebc455de4 2023-02-09 16:56:13,004 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228f0bbdf588a074fe0bf21c7c13a178255 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228f0bbdf588a074fe0bf21c7c13a178255 2023-02-09 16:56:13,005 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/efd19ff0a3bd4d28b088ce33bc4e228b_SeqId_44_ to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/efd19ff0a3bd4d28b088ce33bc4e228b_SeqId_44_ 2023-02-09 16:56:13,005 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231a4167492811e4a5fbfdbd9b5575f55ea to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231a4167492811e4a5fbfdbd9b5575f55ea 2023-02-09 16:56:13,005 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-02-09 16:56:13,005 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-02-09 16:56:13,005 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-09 16:56:13,005 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-09 16:56:13,012 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] throttle.PressureAwareThroughputController(145): a74dd38f0f12c6469fa122f81c49c610#family1#compaction#167 average throughput is 31.12 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 16:56:13,833 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/.tmp/family1/9ac80526ab644dcc9c644eabd7df1ef1 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/9ac80526ab644dcc9c644eabd7df1ef1 2023-02-09 16:56:13,836 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in a74dd38f0f12c6469fa122f81c49c610/family1 of a74dd38f0f12c6469fa122f81c49c610 into 9ac80526ab644dcc9c644eabd7df1ef1(size=167.4 K), total size for store is 167.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-09 16:56:13,837 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for a74dd38f0f12c6469fa122f81c49c610: 2023-02-09 16:56:13,837 INFO [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1675961761714.a74dd38f0f12c6469fa122f81c49c610., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1675961772998; duration=0sec 2023-02-09 16:56:13,837 DEBUG [RS:0;jenkins-hbase4:35511-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 16:56:13,844 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130dee4fdeb886a4e978f6c7425a19db579 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130dee4fdeb886a4e978f6c7425a19db579 2023-02-09 16:56:13,845 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-09 16:56:13,860 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:56:13,860 INFO [MobCompactor-pool-0] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:56:13,867 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/62816ce393384688b52ec6d329d30573 first=Optional[r00] last=Optional[r8] 2023-02-09 16:56:13,867 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1675961761714.a74dd38f0f12c6469fa122f81c49c610., hostname=jenkins-hbase4.apache.org,35511,1675961620699, seqNum=2 for row with hfile group [{family1,hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/62816ce393384688b52ec6d329d30573}] 2023-02-09 16:56:13,869 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.HStore(763): Validating hfile at hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/62816ce393384688b52ec6d329d30573 for inclusion in a74dd38f0f12c6469fa122f81c49c610/family1 2023-02-09 16:56:13,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-02-09 16:56:13,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.HStore(777): Region bounds: first= last= 2023-02-09 16:56:13,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.HRegion(2445): Flush status journal for a74dd38f0f12c6469fa122f81c49c610: 2023-02-09 16:56:13,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/62816ce393384688b52ec6d329d30573 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMinorCompactionWithMonthlyPolicy__uab7k5rt2pe3n4op7if1b87usgi13sf8afbvnnbmehg5cufcc8qba5djrvpc5ccs/family1/62816ce393384688b52ec6d329d30573 2023-02-09 16:56:13,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMinorCompactionWithMonthlyPolicy__uab7k5rt2pe3n4op7if1b87usgi13sf8afbvnnbmehg5cufcc8qba5djrvpc5ccs/family1/62816ce393384688b52ec6d329d30573 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/c60a8c25eb1f45cc9a92338ab3a98e2d_SeqId_50_ 2023-02-09 16:56:13,873 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.HStore(849): Loaded HFile hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMinorCompactionWithMonthlyPolicy__uab7k5rt2pe3n4op7if1b87usgi13sf8afbvnnbmehg5cufcc8qba5djrvpc5ccs/family1/62816ce393384688b52ec6d329d30573 into a74dd38f0f12c6469fa122f81c49c610/family1 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/c60a8c25eb1f45cc9a92338ab3a98e2d_SeqId_50_ - updating store file list. 2023-02-09 16:56:13,876 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.HStore(882): Loaded HFile hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/c60a8c25eb1f45cc9a92338ab3a98e2d_SeqId_50_ into a74dd38f0f12c6469fa122f81c49c610/family1 2023-02-09 16:56:13,876 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.HStore(855): Successfully loaded hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMinorCompactionWithMonthlyPolicy__uab7k5rt2pe3n4op7if1b87usgi13sf8afbvnnbmehg5cufcc8qba5djrvpc5ccs/family1/62816ce393384688b52ec6d329d30573 into a74dd38f0f12c6469fa122f81c49c610/family1 (new location: hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/c60a8c25eb1f45cc9a92338ab3a98e2d_SeqId_50_) 2023-02-09 16:56:13,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMinorCompactionWithMonthlyPolicy__uab7k5rt2pe3n4op7if1b87usgi13sf8afbvnnbmehg5cufcc8qba5djrvpc5ccs/family1/62816ce393384688b52ec6d329d30573 2023-02-09 16:56:13,877 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-09 16:56:13,878 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 16:56:13,879 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511204d559f0ead8544658452914e4b6b3d0e to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511204d559f0ead8544658452914e4b6b3d0e 2023-02-09 16:56:13,880 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511288f01a39dafce4e698e3dff4180e12aad to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511288f01a39dafce4e698e3dff4180e12aad 2023-02-09 16:56:13,881 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130ca6aca8156794eb084eb18712a8aed03 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130ca6aca8156794eb084eb18712a8aed03 2023-02-09 16:56:13,881 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-02-09 16:56:13,881 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-02-09 16:56:13,881 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-09 16:56:13,881 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-09 16:56:13,881 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-09 16:56:13,881 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-09 16:56:13,881 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 16:56:13,883 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=115, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-09 16:56:13,884 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=115, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 1.8880 sec 2023-02-09 16:56:13,889 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/3c45efdb39314b8ab6c8aef33fac5a73, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/d018cffb937b4d3a8b29d2b96933218b, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/4819afd09b034c8eaa3f0538143ded85_SeqId_47_] to archive 2023-02-09 16:56:13,890 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 16:56:13,891 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/3c45efdb39314b8ab6c8aef33fac5a73 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/3c45efdb39314b8ab6c8aef33fac5a73 2023-02-09 16:56:13,892 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/d018cffb937b4d3a8b29d2b96933218b to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/d018cffb937b4d3a8b29d2b96933218b 2023-02-09 16:56:13,893 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/4819afd09b034c8eaa3f0538143ded85_SeqId_47_ to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/family1/4819afd09b034c8eaa3f0538143ded85_SeqId_47_ 2023-02-09 16:56:14,076 INFO [Listener at localhost/41619] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=250 (was 256), OpenFileDescriptor=627 (was 648), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=134 (was 141), ProcessCount=168 (was 168), AvailableMemoryMB=3133 (was 3476) 2023-02-09 16:56:14,089 INFO [Listener at localhost/41619] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=250, OpenFileDescriptor=627, MaxFileDescriptor=60000, SystemLoadAverage=134, ProcessCount=168, AvailableMemoryMB=3133 2023-02-09 16:56:14,115 DEBUG [Listener at localhost/41619] crypto.Encryption(565): Installed org.apache.hadoop.hbase.io.crypto.KeyProviderForTesting into key provider cache 2023-02-09 16:56:14,137 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:56:14,137 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:56:14,169 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10<\x0D\xF2`R\xB7M\xD8\x0B\x12\xFCst\x87\xAF\xF2"\x10P\x13\x8A\xA2\x1D\x80\x8C3\x88D\x99ZF\x0BA**\x10\xC4\xA5#D\x0F\x81`P\xFF\x86\xB6L\x9D\x1F\x06\x942\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-02-09 16:56:14,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure2.ProcedureExecutor(1029): Stored pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionFromAdmin 2023-02-09 16:56:14,171 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 16:56:14,171 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionFromAdmin" procId is: 116 2023-02-09 16:56:14,171 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:56:14,172 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:56:14,172 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 16:56:14,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-09 16:56:14,174 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2 2023-02-09 16:56:14,174 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab 2023-02-09 16:56:14,174 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8 2023-02-09 16:56:14,174 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2 empty. 2023-02-09 16:56:14,174 DEBUG [HFileArchiver-21] backup.HFileArchiver(153): Directory hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab empty. 2023-02-09 16:56:14,174 DEBUG [HFileArchiver-22] backup.HFileArchiver(153): Directory hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8 empty. 2023-02-09 16:56:14,174 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2 2023-02-09 16:56:14,175 DEBUG [HFileArchiver-22] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8 2023-02-09 16:56:14,175 DEBUG [HFileArchiver-21] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab 2023-02-09 16:56:14,175 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMajorCompactionFromAdmin regions 2023-02-09 16:56:14,273 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:56:14,273 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:56:14,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-09 16:56:14,474 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:56:14,474 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:56:14,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-09 16:56:14,583 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp/data/default/testMajorCompactionFromAdmin/.tabledesc/.tableinfo.0000000001 2023-02-09 16:56:14,585 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(7671): creating {ENCODED => cb9647e274752929ab251cba8aca91a8, NAME => 'testMajorCompactionFromAdmin,2,1675961774139.cb9647e274752929ab251cba8aca91a8.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10<\x0D\xF2`R\xB7M\xD8\x0B\x12\xFCst\x87\xAF\xF2"\x10P\x13\x8A\xA2\x1D\x80\x8C3\x88D\x99ZF\x0BA**\x10\xC4\xA5#D\x0F\x81`P\xFF\x86\xB6L\x9D\x1F\x06\x942\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp 2023-02-09 16:56:14,585 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(7671): creating {ENCODED => b6642b7af52cdcee8a7a96045bffa7ab, NAME => 'testMajorCompactionFromAdmin,1,1675961774139.b6642b7af52cdcee8a7a96045bffa7ab.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10<\x0D\xF2`R\xB7M\xD8\x0B\x12\xFCst\x87\xAF\xF2"\x10P\x13\x8A\xA2\x1D\x80\x8C3\x88D\x99ZF\x0BA**\x10\xC4\xA5#D\x0F\x81`P\xFF\x86\xB6L\x9D\x1F\x06\x942\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp 2023-02-09 16:56:14,585 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(7671): creating {ENCODED => 372e344ee104159de14194bcc979bbc2, NAME => 'testMajorCompactionFromAdmin,,1675961774139.372e344ee104159de14194bcc979bbc2.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10<\x0D\xF2`R\xB7M\xD8\x0B\x12\xFCst\x87\xAF\xF2"\x10P\x13\x8A\xA2\x1D\x80\x8C3\x88D\x99ZF\x0BA**\x10\xC4\xA5#D\x0F\x81`P\xFF\x86\xB6L\x9D\x1F\x06\x942\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/.tmp 2023-02-09 16:56:14,596 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,,1675961774139.372e344ee104159de14194bcc979bbc2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 16:56:14,597 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1603): Closing 372e344ee104159de14194bcc979bbc2, disabling compactions & flushes 2023-02-09 16:56:14,597 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,,1675961774139.372e344ee104159de14194bcc979bbc2. 2023-02-09 16:56:14,597 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1675961774139.372e344ee104159de14194bcc979bbc2. 2023-02-09 16:56:14,597 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,,1675961774139.372e344ee104159de14194bcc979bbc2. after waiting 0 ms 2023-02-09 16:56:14,597 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,,1675961774139.372e344ee104159de14194bcc979bbc2. 2023-02-09 16:56:14,597 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,,1675961774139.372e344ee104159de14194bcc979bbc2. 2023-02-09 16:56:14,597 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1557): Region close journal for 372e344ee104159de14194bcc979bbc2: Waiting for close lock at 1675961774597Disabling compacts and flushes for region at 1675961774597Disabling writes for close at 1675961774597Writing region close event to WAL at 1675961774597Closed at 1675961774597 2023-02-09 16:56:14,600 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,1,1675961774139.b6642b7af52cdcee8a7a96045bffa7ab.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 16:56:14,600 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1603): Closing b6642b7af52cdcee8a7a96045bffa7ab, disabling compactions & flushes 2023-02-09 16:56:14,600 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,1,1675961774139.b6642b7af52cdcee8a7a96045bffa7ab. 2023-02-09 16:56:14,600 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1675961774139.b6642b7af52cdcee8a7a96045bffa7ab. 2023-02-09 16:56:14,600 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,1,1675961774139.b6642b7af52cdcee8a7a96045bffa7ab. after waiting 0 ms 2023-02-09 16:56:14,601 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,1,1675961774139.b6642b7af52cdcee8a7a96045bffa7ab. 2023-02-09 16:56:14,601 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,1,1675961774139.b6642b7af52cdcee8a7a96045bffa7ab. 2023-02-09 16:56:14,601 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1557): Region close journal for b6642b7af52cdcee8a7a96045bffa7ab: Waiting for close lock at 1675961774600Disabling compacts and flushes for region at 1675961774600Disabling writes for close at 1675961774601 (+1 ms)Writing region close event to WAL at 1675961774601Closed at 1675961774601 2023-02-09 16:56:14,775 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:56:14,775 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:56:14,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-09 16:56:14,997 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,2,1675961774139.cb9647e274752929ab251cba8aca91a8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 16:56:14,998 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1603): Closing cb9647e274752929ab251cba8aca91a8, disabling compactions & flushes 2023-02-09 16:56:14,998 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,2,1675961774139.cb9647e274752929ab251cba8aca91a8. 2023-02-09 16:56:14,998 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1675961774139.cb9647e274752929ab251cba8aca91a8. 2023-02-09 16:56:14,998 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,2,1675961774139.cb9647e274752929ab251cba8aca91a8. after waiting 0 ms 2023-02-09 16:56:14,998 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,2,1675961774139.cb9647e274752929ab251cba8aca91a8. 2023-02-09 16:56:14,998 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,2,1675961774139.cb9647e274752929ab251cba8aca91a8. 2023-02-09 16:56:14,998 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1557): Region close journal for cb9647e274752929ab251cba8aca91a8: Waiting for close lock at 1675961774998Disabling compacts and flushes for region at 1675961774998Disabling writes for close at 1675961774998Writing region close event to WAL at 1675961774998Closed at 1675961774998 2023-02-09 16:56:15,000 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 16:56:15,001 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,,1675961774139.372e344ee104159de14194bcc979bbc2.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675961775001"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675961775001"}]},"ts":"1675961775001"} 2023-02-09 16:56:15,001 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,1,1675961774139.b6642b7af52cdcee8a7a96045bffa7ab.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1675961775001"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675961775001"}]},"ts":"1675961775001"} 2023-02-09 16:56:15,001 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,2,1675961774139.cb9647e274752929ab251cba8aca91a8.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675961775001"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675961775001"}]},"ts":"1675961775001"} 2023-02-09 16:56:15,003 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-02-09 16:56:15,004 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 16:56:15,004 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675961775004"}]},"ts":"1675961775004"} 2023-02-09 16:56:15,005 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLING in hbase:meta 2023-02-09 16:56:15,007 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=372e344ee104159de14194bcc979bbc2, ASSIGN}, {pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=b6642b7af52cdcee8a7a96045bffa7ab, ASSIGN}, {pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=cb9647e274752929ab251cba8aca91a8, ASSIGN}] 2023-02-09 16:56:15,009 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=cb9647e274752929ab251cba8aca91a8, ASSIGN 2023-02-09 16:56:15,009 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=b6642b7af52cdcee8a7a96045bffa7ab, ASSIGN 2023-02-09 16:56:15,009 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=372e344ee104159de14194bcc979bbc2, ASSIGN 2023-02-09 16:56:15,010 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=cb9647e274752929ab251cba8aca91a8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35511,1675961620699; forceNewPlan=false, retain=false 2023-02-09 16:56:15,010 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=b6642b7af52cdcee8a7a96045bffa7ab, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35511,1675961620699; forceNewPlan=false, retain=false 2023-02-09 16:56:15,010 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=372e344ee104159de14194bcc979bbc2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35511,1675961620699; forceNewPlan=false, retain=false 2023-02-09 16:56:15,161 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=cb9647e274752929ab251cba8aca91a8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:15,161 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=b6642b7af52cdcee8a7a96045bffa7ab, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:15,162 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,2,1675961774139.cb9647e274752929ab251cba8aca91a8.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675961775161"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675961775161"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675961775161"}]},"ts":"1675961775161"} 2023-02-09 16:56:15,161 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=372e344ee104159de14194bcc979bbc2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:15,162 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,1,1675961774139.b6642b7af52cdcee8a7a96045bffa7ab.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1675961775161"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675961775161"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675961775161"}]},"ts":"1675961775161"} 2023-02-09 16:56:15,162 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,,1675961774139.372e344ee104159de14194bcc979bbc2.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675961775161"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675961775161"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675961775161"}]},"ts":"1675961775161"} 2023-02-09 16:56:15,163 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=120, ppid=119, state=RUNNABLE; OpenRegionProcedure cb9647e274752929ab251cba8aca91a8, server=jenkins-hbase4.apache.org,35511,1675961620699}] 2023-02-09 16:56:15,164 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=121, ppid=118, state=RUNNABLE; OpenRegionProcedure b6642b7af52cdcee8a7a96045bffa7ab, server=jenkins-hbase4.apache.org,35511,1675961620699}] 2023-02-09 16:56:15,164 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=122, ppid=117, state=RUNNABLE; OpenRegionProcedure 372e344ee104159de14194bcc979bbc2, server=jenkins-hbase4.apache.org,35511,1675961620699}] 2023-02-09 16:56:15,276 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:56:15,276 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:56:15,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-09 16:56:15,317 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,2,1675961774139.cb9647e274752929ab251cba8aca91a8. 2023-02-09 16:56:15,317 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => cb9647e274752929ab251cba8aca91a8, NAME => 'testMajorCompactionFromAdmin,2,1675961774139.cb9647e274752929ab251cba8aca91a8.', STARTKEY => '2', ENDKEY => ''} 2023-02-09 16:56:15,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin cb9647e274752929ab251cba8aca91a8 2023-02-09 16:56:15,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,2,1675961774139.cb9647e274752929ab251cba8aca91a8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 16:56:15,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for cb9647e274752929ab251cba8aca91a8 2023-02-09 16:56:15,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for cb9647e274752929ab251cba8aca91a8 2023-02-09 16:56:15,339 INFO [StoreOpener-cb9647e274752929ab251cba8aca91a8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region cb9647e274752929ab251cba8aca91a8 2023-02-09 16:56:15,341 DEBUG [StoreOpener-cb9647e274752929ab251cba8aca91a8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/family1 2023-02-09 16:56:15,341 DEBUG [StoreOpener-cb9647e274752929ab251cba8aca91a8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/family1 2023-02-09 16:56:15,341 INFO [StoreOpener-cb9647e274752929ab251cba8aca91a8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cb9647e274752929ab251cba8aca91a8 columnFamilyName family1 2023-02-09 16:56:15,342 INFO [StoreOpener-cb9647e274752929ab251cba8aca91a8-1] regionserver.HStore(310): Store=cb9647e274752929ab251cba8aca91a8/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 16:56:15,342 INFO [StoreOpener-cb9647e274752929ab251cba8aca91a8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region cb9647e274752929ab251cba8aca91a8 2023-02-09 16:56:15,343 DEBUG [StoreOpener-cb9647e274752929ab251cba8aca91a8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/family2 2023-02-09 16:56:15,343 DEBUG [StoreOpener-cb9647e274752929ab251cba8aca91a8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/family2 2023-02-09 16:56:15,343 INFO [StoreOpener-cb9647e274752929ab251cba8aca91a8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cb9647e274752929ab251cba8aca91a8 columnFamilyName family2 2023-02-09 16:56:15,344 INFO [StoreOpener-cb9647e274752929ab251cba8aca91a8-1] regionserver.HStore(310): Store=cb9647e274752929ab251cba8aca91a8/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 16:56:15,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8 2023-02-09 16:56:15,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8 2023-02-09 16:56:15,347 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 16:56:15,347 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for cb9647e274752929ab251cba8aca91a8 2023-02-09 16:56:15,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 16:56:15,349 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened cb9647e274752929ab251cba8aca91a8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69832702, jitterRate=0.04058834910392761}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 16:56:15,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for cb9647e274752929ab251cba8aca91a8: Running coprocessor pre-open hook at 1675961775318Writing region info on filesystem at 1675961775318Initializing all the Stores at 1675961775319 (+1 ms)Instantiating store for column family {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10<\x0D\xF2`R\xB7M\xD8\x0B\x12\xFCst\x87\xAF\xF2"\x10P\x13\x8A\xA2\x1D\x80\x8C3\x88D\x99ZF\x0BA**\x10\xC4\xA5#D\x0F\x81`P\xFF\x86\xB6L\x9D\x1F\x06\x942\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675961775319Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675961775319Cleaning up temporary data from old regions at 1675961775346 (+27 ms)Cleaning up detritus from prior splits at 1675961775346Running coprocessor post-open hooks at 1675961775349 (+3 ms)Region opened successfully at 1675961775349 2023-02-09 16:56:15,350 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,2,1675961774139.cb9647e274752929ab251cba8aca91a8., pid=120, masterSystemTime=1675961775315 2023-02-09 16:56:15,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,2,1675961774139.cb9647e274752929ab251cba8aca91a8. 2023-02-09 16:56:15,351 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,2,1675961774139.cb9647e274752929ab251cba8aca91a8. 2023-02-09 16:56:15,351 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,1,1675961774139.b6642b7af52cdcee8a7a96045bffa7ab. 2023-02-09 16:56:15,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => b6642b7af52cdcee8a7a96045bffa7ab, NAME => 'testMajorCompactionFromAdmin,1,1675961774139.b6642b7af52cdcee8a7a96045bffa7ab.', STARTKEY => '1', ENDKEY => '2'} 2023-02-09 16:56:15,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin b6642b7af52cdcee8a7a96045bffa7ab 2023-02-09 16:56:15,351 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=cb9647e274752929ab251cba8aca91a8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:15,352 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,1,1675961774139.b6642b7af52cdcee8a7a96045bffa7ab.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 16:56:15,352 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for b6642b7af52cdcee8a7a96045bffa7ab 2023-02-09 16:56:15,352 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,2,1675961774139.cb9647e274752929ab251cba8aca91a8.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675961775351"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675961775351"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675961775351"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675961775351"}]},"ts":"1675961775351"} 2023-02-09 16:56:15,352 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for b6642b7af52cdcee8a7a96045bffa7ab 2023-02-09 16:56:15,354 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=120, resume processing ppid=119 2023-02-09 16:56:15,354 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=120, ppid=119, state=SUCCESS; OpenRegionProcedure cb9647e274752929ab251cba8aca91a8, server=jenkins-hbase4.apache.org,35511,1675961620699 in 190 msec 2023-02-09 16:56:15,355 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=119, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=cb9647e274752929ab251cba8aca91a8, ASSIGN in 347 msec 2023-02-09 16:56:15,372 INFO [StoreOpener-b6642b7af52cdcee8a7a96045bffa7ab-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region b6642b7af52cdcee8a7a96045bffa7ab 2023-02-09 16:56:15,373 DEBUG [StoreOpener-b6642b7af52cdcee8a7a96045bffa7ab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/family1 2023-02-09 16:56:15,373 DEBUG [StoreOpener-b6642b7af52cdcee8a7a96045bffa7ab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/family1 2023-02-09 16:56:15,373 INFO [StoreOpener-b6642b7af52cdcee8a7a96045bffa7ab-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b6642b7af52cdcee8a7a96045bffa7ab columnFamilyName family1 2023-02-09 16:56:15,374 INFO [StoreOpener-b6642b7af52cdcee8a7a96045bffa7ab-1] regionserver.HStore(310): Store=b6642b7af52cdcee8a7a96045bffa7ab/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 16:56:15,374 INFO [StoreOpener-b6642b7af52cdcee8a7a96045bffa7ab-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region b6642b7af52cdcee8a7a96045bffa7ab 2023-02-09 16:56:15,375 DEBUG [StoreOpener-b6642b7af52cdcee8a7a96045bffa7ab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/family2 2023-02-09 16:56:15,375 DEBUG [StoreOpener-b6642b7af52cdcee8a7a96045bffa7ab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/family2 2023-02-09 16:56:15,376 INFO [StoreOpener-b6642b7af52cdcee8a7a96045bffa7ab-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b6642b7af52cdcee8a7a96045bffa7ab columnFamilyName family2 2023-02-09 16:56:15,376 INFO [StoreOpener-b6642b7af52cdcee8a7a96045bffa7ab-1] regionserver.HStore(310): Store=b6642b7af52cdcee8a7a96045bffa7ab/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 16:56:15,377 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab 2023-02-09 16:56:15,377 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab 2023-02-09 16:56:15,378 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 16:56:15,379 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for b6642b7af52cdcee8a7a96045bffa7ab 2023-02-09 16:56:15,380 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 16:56:15,381 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened b6642b7af52cdcee8a7a96045bffa7ab; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71656994, jitterRate=0.06777241826057434}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 16:56:15,381 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for b6642b7af52cdcee8a7a96045bffa7ab: Running coprocessor pre-open hook at 1675961775352Writing region info on filesystem at 1675961775352Initializing all the Stores at 1675961775352Instantiating store for column family {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10<\x0D\xF2`R\xB7M\xD8\x0B\x12\xFCst\x87\xAF\xF2"\x10P\x13\x8A\xA2\x1D\x80\x8C3\x88D\x99ZF\x0BA**\x10\xC4\xA5#D\x0F\x81`P\xFF\x86\xB6L\x9D\x1F\x06\x942\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675961775352Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675961775353 (+1 ms)Cleaning up temporary data from old regions at 1675961775377 (+24 ms)Cleaning up detritus from prior splits at 1675961775378 (+1 ms)Running coprocessor post-open hooks at 1675961775381 (+3 ms)Region opened successfully at 1675961775381 2023-02-09 16:56:15,381 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,1,1675961774139.b6642b7af52cdcee8a7a96045bffa7ab., pid=121, masterSystemTime=1675961775315 2023-02-09 16:56:15,382 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,1,1675961774139.b6642b7af52cdcee8a7a96045bffa7ab. 2023-02-09 16:56:15,382 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,1,1675961774139.b6642b7af52cdcee8a7a96045bffa7ab. 2023-02-09 16:56:15,382 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,,1675961774139.372e344ee104159de14194bcc979bbc2. 2023-02-09 16:56:15,382 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 372e344ee104159de14194bcc979bbc2, NAME => 'testMajorCompactionFromAdmin,,1675961774139.372e344ee104159de14194bcc979bbc2.', STARTKEY => '', ENDKEY => '1'} 2023-02-09 16:56:15,383 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=b6642b7af52cdcee8a7a96045bffa7ab, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:15,383 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 372e344ee104159de14194bcc979bbc2 2023-02-09 16:56:15,383 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,1,1675961774139.b6642b7af52cdcee8a7a96045bffa7ab.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1675961775382"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675961775382"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675961775382"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675961775382"}]},"ts":"1675961775382"} 2023-02-09 16:56:15,383 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,,1675961774139.372e344ee104159de14194bcc979bbc2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 16:56:15,383 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 372e344ee104159de14194bcc979bbc2 2023-02-09 16:56:15,383 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 372e344ee104159de14194bcc979bbc2 2023-02-09 16:56:15,385 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=121, resume processing ppid=118 2023-02-09 16:56:15,385 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=121, ppid=118, state=SUCCESS; OpenRegionProcedure b6642b7af52cdcee8a7a96045bffa7ab, server=jenkins-hbase4.apache.org,35511,1675961620699 in 220 msec 2023-02-09 16:56:15,386 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=b6642b7af52cdcee8a7a96045bffa7ab, ASSIGN in 378 msec 2023-02-09 16:56:15,403 INFO [StoreOpener-372e344ee104159de14194bcc979bbc2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 372e344ee104159de14194bcc979bbc2 2023-02-09 16:56:15,404 DEBUG [StoreOpener-372e344ee104159de14194bcc979bbc2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/family1 2023-02-09 16:56:15,404 DEBUG [StoreOpener-372e344ee104159de14194bcc979bbc2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/family1 2023-02-09 16:56:15,405 INFO [StoreOpener-372e344ee104159de14194bcc979bbc2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 372e344ee104159de14194bcc979bbc2 columnFamilyName family1 2023-02-09 16:56:15,405 INFO [StoreOpener-372e344ee104159de14194bcc979bbc2-1] regionserver.HStore(310): Store=372e344ee104159de14194bcc979bbc2/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 16:56:15,406 INFO [StoreOpener-372e344ee104159de14194bcc979bbc2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 372e344ee104159de14194bcc979bbc2 2023-02-09 16:56:15,406 DEBUG [StoreOpener-372e344ee104159de14194bcc979bbc2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/family2 2023-02-09 16:56:15,406 DEBUG [StoreOpener-372e344ee104159de14194bcc979bbc2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/family2 2023-02-09 16:56:15,407 INFO [StoreOpener-372e344ee104159de14194bcc979bbc2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 372e344ee104159de14194bcc979bbc2 columnFamilyName family2 2023-02-09 16:56:15,407 INFO [StoreOpener-372e344ee104159de14194bcc979bbc2-1] regionserver.HStore(310): Store=372e344ee104159de14194bcc979bbc2/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 16:56:15,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2 2023-02-09 16:56:15,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2 2023-02-09 16:56:15,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 16:56:15,410 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 372e344ee104159de14194bcc979bbc2 2023-02-09 16:56:15,411 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 16:56:15,411 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 372e344ee104159de14194bcc979bbc2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66308329, jitterRate=-0.011928901076316833}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 16:56:15,411 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 372e344ee104159de14194bcc979bbc2: Running coprocessor pre-open hook at 1675961775383Writing region info on filesystem at 1675961775383Initializing all the Stores at 1675961775384 (+1 ms)Instantiating store for column family {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10<\x0D\xF2`R\xB7M\xD8\x0B\x12\xFCst\x87\xAF\xF2"\x10P\x13\x8A\xA2\x1D\x80\x8C3\x88D\x99ZF\x0BA**\x10\xC4\xA5#D\x0F\x81`P\xFF\x86\xB6L\x9D\x1F\x06\x942\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675961775384Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675961775384Cleaning up temporary data from old regions at 1675961775408 (+24 ms)Cleaning up detritus from prior splits at 1675961775409 (+1 ms)Running coprocessor post-open hooks at 1675961775411 (+2 ms)Region opened successfully at 1675961775411 2023-02-09 16:56:15,412 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,,1675961774139.372e344ee104159de14194bcc979bbc2., pid=122, masterSystemTime=1675961775315 2023-02-09 16:56:15,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,,1675961774139.372e344ee104159de14194bcc979bbc2. 2023-02-09 16:56:15,413 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,,1675961774139.372e344ee104159de14194bcc979bbc2. 2023-02-09 16:56:15,413 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=372e344ee104159de14194bcc979bbc2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:15,413 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,,1675961774139.372e344ee104159de14194bcc979bbc2.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675961775413"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675961775413"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675961775413"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675961775413"}]},"ts":"1675961775413"} 2023-02-09 16:56:15,415 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=122, resume processing ppid=117 2023-02-09 16:56:15,415 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=122, ppid=117, state=SUCCESS; OpenRegionProcedure 372e344ee104159de14194bcc979bbc2, server=jenkins-hbase4.apache.org,35511,1675961620699 in 250 msec 2023-02-09 16:56:15,417 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=116 2023-02-09 16:56:15,417 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=372e344ee104159de14194bcc979bbc2, ASSIGN in 408 msec 2023-02-09 16:56:15,417 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 16:56:15,417 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675961775417"}]},"ts":"1675961775417"} 2023-02-09 16:56:15,418 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLED in hbase:meta 2023-02-09 16:56:15,420 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 16:56:15,421 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=116, state=SUCCESS; CreateTableProcedure table=testMajorCompactionFromAdmin in 1.2510 sec 2023-02-09 16:56:16,277 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:56:16,277 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:56:16,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-09 16:56:16,278 INFO [Listener at localhost/41619] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionFromAdmin, procId: 116 completed 2023-02-09 16:56:16,283 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,,1675961774139.372e344ee104159de14194bcc979bbc2. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 16:56:16,284 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,1,1675961774139.b6642b7af52cdcee8a7a96045bffa7ab. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 16:56:16,284 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,2,1675961774139.cb9647e274752929ab251cba8aca91a8. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 16:56:16,285 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:56:16,286 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:56:16,286 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:56:16,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-02-09 16:56:16,288 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-02-09 16:56:16,288 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:56:16,288 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-02-09 16:56:16,288 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-02-09 16:56:16,288 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 16:56:16,288 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-09 16:56:16,298 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:56:16,298 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:16,298 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:56:16,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:56:16,298 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:16,298 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:56:16,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-09 16:56:16,298 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 16:56:16,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:56:16,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-09 16:56:16,298 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-02-09 16:56:16,299 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-02-09 16:56:16,299 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-02-09 16:56:16,299 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:56:16,299 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-02-09 16:56:16,299 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1675961774139.b6642b7af52cdcee8a7a96045bffa7ab. 2023-02-09 16:56:16,299 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1675961774139.b6642b7af52cdcee8a7a96045bffa7ab. started... 2023-02-09 16:56:16,299 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-09 16:56:16,299 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:56:16,299 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1675961774139.cb9647e274752929ab251cba8aca91a8. 2023-02-09 16:56:16,300 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing b6642b7af52cdcee8a7a96045bffa7ab 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-09 16:56:16,300 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1675961774139.372e344ee104159de14194bcc979bbc2. 2023-02-09 16:56:16,300 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1675961774139.372e344ee104159de14194bcc979bbc2. started... 2023-02-09 16:56:16,300 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1675961774139.cb9647e274752929ab251cba8aca91a8. started... 2023-02-09 16:56:16,301 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 372e344ee104159de14194bcc979bbc2 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-09 16:56:16,301 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing cb9647e274752929ab251cba8aca91a8 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-09 16:56:16,364 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230209b7db6f1069a24bc09a8ff5b638306376 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230209b7db6f1069a24bc09a8ff5b638306376 2023-02-09 16:56:16,750 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023020915cc3364bfd04e8984025d7b88518f74 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023020915cc3364bfd04e8984025d7b88518f74 2023-02-09 16:56:16,750 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302099bea3e8d1eb249738ed5afdf79fece04 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302099bea3e8d1eb249738ed5afdf79fece04 2023-02-09 16:56:16,784 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/.tmp/family1/4d7fc49b664c4b1bb12aa7ab2f309128 2023-02-09 16:56:17,165 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/.tmp/family1/28ef5911823845dda0b9a046980d76c0 2023-02-09 16:56:17,165 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/.tmp/family1/699048a830864852905bb5ff52187c24 2023-02-09 16:56:17,216 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302095328804ee2574d1ab2445af44c0ac036 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202302095328804ee2574d1ab2445af44c0ac036 2023-02-09 16:56:17,601 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302098543b51e8cd54461aeff8623903769de to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202302098543b51e8cd54461aeff8623903769de 2023-02-09 16:56:17,609 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230209c26d161679734e53b35352bcb504e519 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20230209c26d161679734e53b35352bcb504e519 2023-02-09 16:56:17,620 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/.tmp/family2/b66eecbfe13a49de92e1c8293649c33e 2023-02-09 16:56:17,624 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/.tmp/family1/4d7fc49b664c4b1bb12aa7ab2f309128 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/family1/4d7fc49b664c4b1bb12aa7ab2f309128 2023-02-09 16:56:17,655 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/family1/4d7fc49b664c4b1bb12aa7ab2f309128, entries=4, sequenceid=5, filesize=5.5 K 2023-02-09 16:56:17,655 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/.tmp/family2/b66eecbfe13a49de92e1c8293649c33e as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/family2/b66eecbfe13a49de92e1c8293649c33e 2023-02-09 16:56:17,659 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/family2/b66eecbfe13a49de92e1c8293649c33e, entries=2, sequenceid=5, filesize=5.1 K 2023-02-09 16:56:17,660 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for b6642b7af52cdcee8a7a96045bffa7ab in 1360ms, sequenceid=5, compaction requested=false 2023-02-09 16:56:17,660 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionFromAdmin' 2023-02-09 16:56:17,660 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for b6642b7af52cdcee8a7a96045bffa7ab: 2023-02-09 16:56:17,660 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1675961774139.b6642b7af52cdcee8a7a96045bffa7ab. 2023-02-09 16:56:17,660 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-09 16:56:18,006 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/.tmp/family2/b25c52f5e23e49a2bec401c46b5f932b 2023-02-09 16:56:18,010 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/.tmp/family1/28ef5911823845dda0b9a046980d76c0 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/family1/28ef5911823845dda0b9a046980d76c0 2023-02-09 16:56:18,014 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/.tmp/family2/940989463eae401999ff5fb039e53b07 2023-02-09 16:56:18,017 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/.tmp/family1/699048a830864852905bb5ff52187c24 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/family1/699048a830864852905bb5ff52187c24 2023-02-09 16:56:18,034 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/family1/28ef5911823845dda0b9a046980d76c0, entries=4, sequenceid=5, filesize=5.5 K 2023-02-09 16:56:18,035 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/.tmp/family2/b25c52f5e23e49a2bec401c46b5f932b as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/family2/b25c52f5e23e49a2bec401c46b5f932b 2023-02-09 16:56:18,038 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/family2/b25c52f5e23e49a2bec401c46b5f932b, entries=2, sequenceid=5, filesize=5.1 K 2023-02-09 16:56:18,039 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 372e344ee104159de14194bcc979bbc2 in 1738ms, sequenceid=5, compaction requested=false 2023-02-09 16:56:18,040 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 372e344ee104159de14194bcc979bbc2: 2023-02-09 16:56:18,040 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1675961774139.372e344ee104159de14194bcc979bbc2. 2023-02-09 16:56:18,040 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-09 16:56:18,042 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/family1/699048a830864852905bb5ff52187c24, entries=4, sequenceid=5, filesize=5.5 K 2023-02-09 16:56:18,043 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/.tmp/family2/940989463eae401999ff5fb039e53b07 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/family2/940989463eae401999ff5fb039e53b07 2023-02-09 16:56:18,046 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/family2/940989463eae401999ff5fb039e53b07, entries=2, sequenceid=5, filesize=5.1 K 2023-02-09 16:56:18,046 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for cb9647e274752929ab251cba8aca91a8 in 1745ms, sequenceid=5, compaction requested=false 2023-02-09 16:56:18,046 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for cb9647e274752929ab251cba8aca91a8: 2023-02-09 16:56:18,046 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1675961774139.cb9647e274752929ab251cba8aca91a8. 2023-02-09 16:56:18,046 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-09 16:56:18,046 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-09 16:56:18,046 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:18,047 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-02-09 16:56:18,047 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-02-09 16:56:18,048 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 16:56:18,048 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:18,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:18,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:56:18,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:56:18,048 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 16:56:18,048 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:56:18,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:56:18,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:56:18,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 16:56:18,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:18,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:56:18,050 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-02-09 16:56:18,050 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3eece3ca[Count = 0] remaining members to acquire global barrier 2023-02-09 16:56:18,050 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-02-09 16:56:18,050 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 16:56:18,051 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 16:56:18,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 16:56:18,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 16:56:18,051 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-02-09 16:56:18,051 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:18,051 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:56:18,051 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-02-09 16:56:18,051 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:56:18,052 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:18,052 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-02-09 16:56:18,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:18,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:56:18,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:56:18,052 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:56:18,052 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-02-09 16:56:18,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:56:18,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:56:18,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 16:56:18,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:18,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:56:18,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 16:56:18,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:18,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:56:18,054 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-02-09 16:56:18,054 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-02-09 16:56:18,054 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:56:18,054 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:56:18,055 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-02-09 16:56:18,055 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:56:18,057 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 16:56:18,057 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 16:56:18,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 16:56:18,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:56:18,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:56:18,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 16:56:18,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 16:56:18,057 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:56:18,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:56:18,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:56:18,057 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:18,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:56:18,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 16:56:18,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 16:56:18,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:56:18,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 16:56:18,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:18,058 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:18,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:56:18,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 16:56:18,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:18,060 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:56:18,060 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:18,060 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:56:18,060 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:56:18,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:56:18,060 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-02-09 16:56:18,060 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:56:18,060 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-09 16:56:18,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:56:18,061 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-09 16:56:18,061 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:18,061 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 16:56:18,061 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 16:56:18,061 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 16:56:18,061 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-02-09 16:56:18,061 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:56:18,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:56:18,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:56:18,161 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:56:18,161 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:56:18,161 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:56:18,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:56:18,163 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,,1675961774139.372e344ee104159de14194bcc979bbc2. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 16:56:18,163 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,1,1675961774139.b6642b7af52cdcee8a7a96045bffa7ab. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 16:56:18,163 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,2,1675961774139.cb9647e274752929ab251cba8aca91a8. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 16:56:18,165 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:56:18,165 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:56:18,166 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:56:18,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-02-09 16:56:18,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-02-09 16:56:18,167 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-02-09 16:56:18,167 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:56:18,168 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-02-09 16:56:18,168 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-02-09 16:56:18,168 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 16:56:18,168 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-09 16:56:18,170 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:18,170 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:56:18,170 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:56:18,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:56:18,170 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:18,170 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:56:18,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-09 16:56:18,171 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 16:56:18,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:56:18,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-09 16:56:18,171 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-02-09 16:56:18,171 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-02-09 16:56:18,171 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-02-09 16:56:18,171 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-02-09 16:56:18,171 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:56:18,171 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-02-09 16:56:18,172 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1675961774139.b6642b7af52cdcee8a7a96045bffa7ab. 2023-02-09 16:56:18,172 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1675961774139.b6642b7af52cdcee8a7a96045bffa7ab. started... 2023-02-09 16:56:18,172 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing b6642b7af52cdcee8a7a96045bffa7ab 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-09 16:56:18,173 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1675961774139.cb9647e274752929ab251cba8aca91a8. 2023-02-09 16:56:18,173 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-09 16:56:18,173 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:56:18,173 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1675961774139.cb9647e274752929ab251cba8aca91a8. started... 2023-02-09 16:56:18,173 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1675961774139.372e344ee104159de14194bcc979bbc2. 2023-02-09 16:56:18,173 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1675961774139.372e344ee104159de14194bcc979bbc2. started... 2023-02-09 16:56:18,173 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing cb9647e274752929ab251cba8aca91a8 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-09 16:56:18,173 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 372e344ee104159de14194bcc979bbc2 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-09 16:56:18,227 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230209d123888f1c414abe99b13af598aeeef6 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230209d123888f1c414abe99b13af598aeeef6 2023-02-09 16:56:18,624 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230209da636ec90f9b4a47b65ee483e06c08ba to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230209da636ec90f9b4a47b65ee483e06c08ba 2023-02-09 16:56:18,624 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302091624ad0ff735489abf689307d0c24033 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202302091624ad0ff735489abf689307d0c24033 2023-02-09 16:56:18,639 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/.tmp/family1/4349a6505e80472e84cf9ae1337eb2c1 2023-02-09 16:56:18,642 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/.tmp/family1/f824cc7da99c40098f639dca8b2fd26f 2023-02-09 16:56:19,048 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/.tmp/family1/cd1564701b334d4191808882717bbc3a 2023-02-09 16:56:19,080 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230209ac2763cf4d4d45ff9076ded420ca54cd to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20230209ac2763cf4d4d45ff9076ded420ca54cd 2023-02-09 16:56:19,081 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230209e8e89bb6654e4d58a1e97509795e74ae to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230209e8e89bb6654e4d58a1e97509795e74ae 2023-02-09 16:56:19,481 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023020926f8ca9f7f3c4496b6f9ff807eb7c49f to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c2023020926f8ca9f7f3c4496b6f9ff807eb7c49f 2023-02-09 16:56:19,485 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/.tmp/family2/c28e4590fd3747e0800a9be6612c414a 2023-02-09 16:56:19,486 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/.tmp/family2/a09fc31e512a480c9969437844f1ad15 2023-02-09 16:56:19,488 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/.tmp/family1/4349a6505e80472e84cf9ae1337eb2c1 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/family1/4349a6505e80472e84cf9ae1337eb2c1 2023-02-09 16:56:19,489 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/.tmp/family1/f824cc7da99c40098f639dca8b2fd26f as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/family1/f824cc7da99c40098f639dca8b2fd26f 2023-02-09 16:56:19,512 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/family1/f824cc7da99c40098f639dca8b2fd26f, entries=4, sequenceid=9, filesize=5.5 K 2023-02-09 16:56:19,512 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/family1/4349a6505e80472e84cf9ae1337eb2c1, entries=4, sequenceid=9, filesize=5.5 K 2023-02-09 16:56:19,512 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/.tmp/family2/c28e4590fd3747e0800a9be6612c414a as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/family2/c28e4590fd3747e0800a9be6612c414a 2023-02-09 16:56:19,512 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/.tmp/family2/a09fc31e512a480c9969437844f1ad15 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/family2/a09fc31e512a480c9969437844f1ad15 2023-02-09 16:56:19,516 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/family2/c28e4590fd3747e0800a9be6612c414a, entries=2, sequenceid=9, filesize=5.1 K 2023-02-09 16:56:19,516 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/family2/a09fc31e512a480c9969437844f1ad15, entries=2, sequenceid=9, filesize=5.1 K 2023-02-09 16:56:19,517 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for b6642b7af52cdcee8a7a96045bffa7ab in 1344ms, sequenceid=9, compaction requested=false 2023-02-09 16:56:19,517 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for b6642b7af52cdcee8a7a96045bffa7ab: 2023-02-09 16:56:19,517 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1675961774139.b6642b7af52cdcee8a7a96045bffa7ab. 2023-02-09 16:56:19,517 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 372e344ee104159de14194bcc979bbc2 in 1344ms, sequenceid=9, compaction requested=false 2023-02-09 16:56:19,517 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-09 16:56:19,517 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 372e344ee104159de14194bcc979bbc2: 2023-02-09 16:56:19,517 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1675961774139.372e344ee104159de14194bcc979bbc2. 2023-02-09 16:56:19,517 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-09 16:56:19,885 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/.tmp/family2/62e62ff835414f669699e5b5ed7a1d29 2023-02-09 16:56:19,890 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/.tmp/family1/cd1564701b334d4191808882717bbc3a as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/family1/cd1564701b334d4191808882717bbc3a 2023-02-09 16:56:19,912 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/family1/cd1564701b334d4191808882717bbc3a, entries=4, sequenceid=9, filesize=5.5 K 2023-02-09 16:56:19,913 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/.tmp/family2/62e62ff835414f669699e5b5ed7a1d29 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/family2/62e62ff835414f669699e5b5ed7a1d29 2023-02-09 16:56:19,917 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/family2/62e62ff835414f669699e5b5ed7a1d29, entries=2, sequenceid=9, filesize=5.1 K 2023-02-09 16:56:19,918 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for cb9647e274752929ab251cba8aca91a8 in 1745ms, sequenceid=9, compaction requested=false 2023-02-09 16:56:19,918 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for cb9647e274752929ab251cba8aca91a8: 2023-02-09 16:56:19,918 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1675961774139.cb9647e274752929ab251cba8aca91a8. 2023-02-09 16:56:19,918 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-09 16:56:19,918 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-09 16:56:19,918 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:19,918 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-02-09 16:56:19,918 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-02-09 16:56:19,919 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:19,919 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 16:56:19,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:19,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:56:19,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:56:19,920 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 16:56:19,920 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:56:19,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:56:19,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:56:19,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 16:56:19,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:19,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:56:19,921 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-02-09 16:56:19,921 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@314678b[Count = 0] remaining members to acquire global barrier 2023-02-09 16:56:19,921 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-02-09 16:56:19,921 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 16:56:19,922 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 16:56:19,922 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 16:56:19,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 16:56:19,922 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-02-09 16:56:19,922 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-02-09 16:56:19,923 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:56:19,923 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:19,923 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:56:19,924 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-02-09 16:56:19,924 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:19,924 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:56:19,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:19,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:56:19,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:56:19,924 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-02-09 16:56:19,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:56:19,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:56:19,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 16:56:19,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:19,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:56:19,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 16:56:19,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:19,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:56:19,926 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-02-09 16:56:19,926 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-02-09 16:56:19,926 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:56:19,926 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:56:19,926 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-02-09 16:56:19,926 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:56:19,928 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 16:56:19,929 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:56:19,929 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 16:56:19,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 16:56:19,929 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 16:56:19,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 16:56:19,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:56:19,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:56:19,929 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:56:19,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:56:19,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 16:56:19,930 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:19,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:56:19,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 16:56:19,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:56:19,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 16:56:19,931 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:19,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:19,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:56:19,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 16:56:19,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:19,933 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:19,933 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-09 16:56:19,933 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-09 16:56:19,933 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:19,933 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-02-09 16:56:19,933 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:56:19,933 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:56:19,933 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 16:56:19,933 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:56:19,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:56:19,933 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:56:19,933 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 16:56:19,934 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 16:56:19,933 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:56:19,934 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-02-09 16:56:19,934 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:56:19,934 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-02-09 16:56:19,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:56:19,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:56:20,034 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:56:20,034 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:56:20,034 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:56:20,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:56:20,036 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,,1675961774139.372e344ee104159de14194bcc979bbc2. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 16:56:20,036 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,1,1675961774139.b6642b7af52cdcee8a7a96045bffa7ab. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 16:56:20,036 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,2,1675961774139.cb9647e274752929ab251cba8aca91a8. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 16:56:20,038 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:56:20,038 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:56:20,039 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:56:20,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-02-09 16:56:20,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-02-09 16:56:20,040 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-02-09 16:56:20,040 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:56:20,040 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-02-09 16:56:20,040 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-02-09 16:56:20,041 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 16:56:20,041 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-09 16:56:20,043 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:20,043 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:56:20,043 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:56:20,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:56:20,043 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:20,043 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:56:20,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-09 16:56:20,043 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 16:56:20,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:56:20,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-09 16:56:20,044 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-02-09 16:56:20,044 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-02-09 16:56:20,044 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-02-09 16:56:20,044 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-02-09 16:56:20,044 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:56:20,044 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-02-09 16:56:20,044 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1675961774139.b6642b7af52cdcee8a7a96045bffa7ab. 2023-02-09 16:56:20,044 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1675961774139.b6642b7af52cdcee8a7a96045bffa7ab. started... 2023-02-09 16:56:20,044 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-09 16:56:20,044 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1675961774139.cb9647e274752929ab251cba8aca91a8. 2023-02-09 16:56:20,044 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing b6642b7af52cdcee8a7a96045bffa7ab 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-09 16:56:20,044 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1675961774139.cb9647e274752929ab251cba8aca91a8. started... 2023-02-09 16:56:20,044 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1675961774139.372e344ee104159de14194bcc979bbc2. 2023-02-09 16:56:20,044 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:56:20,045 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing cb9647e274752929ab251cba8aca91a8 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-09 16:56:20,045 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1675961774139.372e344ee104159de14194bcc979bbc2. started... 2023-02-09 16:56:20,045 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 372e344ee104159de14194bcc979bbc2 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-09 16:56:20,101 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023020971bf630baa30404aa3a8e6c2c9b90949 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023020971bf630baa30404aa3a8e6c2c9b90949 2023-02-09 16:56:20,101 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302094cf172abf99c454e89caf583870cfdd4 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302094cf172abf99c454e89caf583870cfdd4 2023-02-09 16:56:20,116 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/.tmp/family1/d40889a1900a4d029ec6c6ea284ada6d 2023-02-09 16:56:20,504 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023020998231501dac04ef780cf8b643fb5e460 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023020998231501dac04ef780cf8b643fb5e460 2023-02-09 16:56:20,516 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/.tmp/family1/ed198d32849142f7997552f866f212ab 2023-02-09 16:56:20,519 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/.tmp/family1/a392de2b239e4c33b92ddbfdf2269edf 2023-02-09 16:56:20,547 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230209271347fcce82420fb02ab5b9be3623fe to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20230209271347fcce82420fb02ab5b9be3623fe 2023-02-09 16:56:20,564 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/.tmp/family2/0ab4bdabb26e40ffadf5a4057832cce2 2023-02-09 16:56:20,568 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/.tmp/family1/d40889a1900a4d029ec6c6ea284ada6d as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/family1/d40889a1900a4d029ec6c6ea284ada6d 2023-02-09 16:56:20,572 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023020976f424ce442a4151a7f66fc5cc8ebe39 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b2023020976f424ce442a4151a7f66fc5cc8ebe39 2023-02-09 16:56:20,592 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/family1/d40889a1900a4d029ec6c6ea284ada6d, entries=4, sequenceid=13, filesize=5.5 K 2023-02-09 16:56:20,593 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/.tmp/family2/0ab4bdabb26e40ffadf5a4057832cce2 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/family2/0ab4bdabb26e40ffadf5a4057832cce2 2023-02-09 16:56:20,595 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/family2/0ab4bdabb26e40ffadf5a4057832cce2, entries=2, sequenceid=13, filesize=5.1 K 2023-02-09 16:56:20,596 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for cb9647e274752929ab251cba8aca91a8 in 551ms, sequenceid=13, compaction requested=true 2023-02-09 16:56:20,596 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for cb9647e274752929ab251cba8aca91a8: 2023-02-09 16:56:20,596 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1675961774139.cb9647e274752929ab251cba8aca91a8. 2023-02-09 16:56:20,596 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-09 16:56:20,855 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-09 16:56:20,973 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230209e23f905204c545348b4dfb21fa812ba7 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230209e23f905204c545348b4dfb21fa812ba7 2023-02-09 16:56:20,980 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/.tmp/family2/27d71aa6d0f448ae8470c89907c993e4 2023-02-09 16:56:20,983 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/.tmp/family1/ed198d32849142f7997552f866f212ab as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/family1/ed198d32849142f7997552f866f212ab 2023-02-09 16:56:21,005 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/family1/ed198d32849142f7997552f866f212ab, entries=4, sequenceid=13, filesize=5.5 K 2023-02-09 16:56:21,006 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/.tmp/family2/27d71aa6d0f448ae8470c89907c993e4 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/family2/27d71aa6d0f448ae8470c89907c993e4 2023-02-09 16:56:21,010 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/family2/27d71aa6d0f448ae8470c89907c993e4, entries=2, sequenceid=13, filesize=5.1 K 2023-02-09 16:56:21,010 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for b6642b7af52cdcee8a7a96045bffa7ab in 966ms, sequenceid=13, compaction requested=true 2023-02-09 16:56:21,010 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for b6642b7af52cdcee8a7a96045bffa7ab: 2023-02-09 16:56:21,010 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1675961774139.b6642b7af52cdcee8a7a96045bffa7ab. 2023-02-09 16:56:21,010 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-09 16:56:21,377 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/.tmp/family2/cce886f918f04a05a5c34ad7aabf71cf 2023-02-09 16:56:21,382 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/.tmp/family1/a392de2b239e4c33b92ddbfdf2269edf as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/family1/a392de2b239e4c33b92ddbfdf2269edf 2023-02-09 16:56:21,406 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/family1/a392de2b239e4c33b92ddbfdf2269edf, entries=4, sequenceid=13, filesize=5.5 K 2023-02-09 16:56:21,407 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/.tmp/family2/cce886f918f04a05a5c34ad7aabf71cf as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/family2/cce886f918f04a05a5c34ad7aabf71cf 2023-02-09 16:56:21,410 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/family2/cce886f918f04a05a5c34ad7aabf71cf, entries=2, sequenceid=13, filesize=5.1 K 2023-02-09 16:56:21,411 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 372e344ee104159de14194bcc979bbc2 in 1366ms, sequenceid=13, compaction requested=true 2023-02-09 16:56:21,411 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 372e344ee104159de14194bcc979bbc2: 2023-02-09 16:56:21,411 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1675961774139.372e344ee104159de14194bcc979bbc2. 2023-02-09 16:56:21,411 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-09 16:56:21,411 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-09 16:56:21,411 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:21,411 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-02-09 16:56:21,411 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-02-09 16:56:21,413 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 16:56:21,413 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:21,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:21,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:56:21,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:56:21,413 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 16:56:21,413 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:56:21,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:56:21,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:56:21,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 16:56:21,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:21,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:56:21,414 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-02-09 16:56:21,414 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3b593dd4[Count = 0] remaining members to acquire global barrier 2023-02-09 16:56:21,414 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-02-09 16:56:21,414 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 16:56:21,417 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 16:56:21,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 16:56:21,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 16:56:21,417 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-02-09 16:56:21,417 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-02-09 16:56:21,417 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:56:21,417 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:21,417 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:56:21,418 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:21,418 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-02-09 16:56:21,418 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:56:21,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:21,418 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-02-09 16:56:21,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:56:21,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:56:21,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:56:21,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:56:21,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 16:56:21,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:21,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:56:21,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 16:56:21,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:21,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:56:21,420 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-02-09 16:56:21,420 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-02-09 16:56:21,420 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:56:21,420 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:56:21,420 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-02-09 16:56:21,420 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:56:21,421 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 16:56:21,421 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 16:56:21,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 16:56:21,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:56:21,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:56:21,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 16:56:21,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 16:56:21,422 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:56:21,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:56:21,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:56:21,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:56:21,422 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:21,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 16:56:21,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 16:56:21,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:56:21,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 16:56:21,423 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:21,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:21,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:56:21,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 16:56:21,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:21,425 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:56:21,425 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:56:21,425 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:21,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:56:21,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:56:21,425 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-09 16:56:21,425 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-02-09 16:56:21,425 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:56:21,425 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:56:21,426 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:56:21,425 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-09 16:56:21,426 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:21,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:56:21,426 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 16:56:21,426 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-02-09 16:56:21,426 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:56:21,426 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 16:56:21,426 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 16:56:21,526 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:56:21,526 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:56:21,526 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:56:21,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:56:21,528 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,,1675961774139.372e344ee104159de14194bcc979bbc2. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 16:56:21,528 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,1,1675961774139.b6642b7af52cdcee8a7a96045bffa7ab. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 16:56:21,529 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,2,1675961774139.cb9647e274752929ab251cba8aca91a8. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 16:56:21,530 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:56:21,530 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:56:21,531 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:56:21,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-02-09 16:56:21,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-02-09 16:56:21,532 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-02-09 16:56:21,532 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:56:21,532 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-02-09 16:56:21,532 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-02-09 16:56:21,533 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 16:56:21,533 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-09 16:56:21,540 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:21,540 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:56:21,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:56:21,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:56:21,540 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:21,540 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:56:21,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-09 16:56:21,541 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 16:56:21,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:56:21,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-09 16:56:21,541 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-02-09 16:56:21,541 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-02-09 16:56:21,541 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-02-09 16:56:21,541 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-02-09 16:56:21,542 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:56:21,542 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-02-09 16:56:21,542 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1675961774139.b6642b7af52cdcee8a7a96045bffa7ab. 2023-02-09 16:56:21,542 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1675961774139.b6642b7af52cdcee8a7a96045bffa7ab. started... 2023-02-09 16:56:21,542 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1675961774139.cb9647e274752929ab251cba8aca91a8. 2023-02-09 16:56:21,542 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-09 16:56:21,542 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1675961774139.372e344ee104159de14194bcc979bbc2. 2023-02-09 16:56:21,542 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:56:21,542 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing b6642b7af52cdcee8a7a96045bffa7ab 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-09 16:56:21,542 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1675961774139.cb9647e274752929ab251cba8aca91a8. started... 2023-02-09 16:56:21,542 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1675961774139.372e344ee104159de14194bcc979bbc2. started... 2023-02-09 16:56:21,542 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing cb9647e274752929ab251cba8aca91a8 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-09 16:56:21,542 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 372e344ee104159de14194bcc979bbc2 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-09 16:56:21,986 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302098ac0e160835542dc91a14bee2f64c7c8 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202302098ac0e160835542dc91a14bee2f64c7c8 2023-02-09 16:56:21,987 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230209c9ea79d3f10d42e8928a86444f3e4451 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230209c9ea79d3f10d42e8928a86444f3e4451 2023-02-09 16:56:21,992 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302098681e559df29460b915043ed5fc0ed9e to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302098681e559df29460b915043ed5fc0ed9e 2023-02-09 16:56:22,400 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/.tmp/family1/56292a2434d84873aa507253e1653d6b 2023-02-09 16:56:22,403 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/.tmp/family1/e8e87291fd3e42a8a484c96d35d448c5 2023-02-09 16:56:22,407 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/.tmp/family1/b3e463576bc240c08dfb0ca03d4a5cb3 2023-02-09 16:56:22,449 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302097333499362934e9b8038b368ac8fba88 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202302097333499362934e9b8038b368ac8fba88 2023-02-09 16:56:22,849 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230209974b1ca162d4447c844c5379f058fb38 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20230209974b1ca162d4447c844c5379f058fb38 2023-02-09 16:56:22,853 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230209579c1cf8575a4a9c9d69d61c3db1ec74 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20230209579c1cf8575a4a9c9d69d61c3db1ec74 2023-02-09 16:56:22,855 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/.tmp/family2/bf9b9699eceb456fa355845444a1c11a 2023-02-09 16:56:22,860 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/.tmp/family2/718a9fd6fe9f420eaf17cfe57ac51091 2023-02-09 16:56:22,863 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/.tmp/family1/b3e463576bc240c08dfb0ca03d4a5cb3 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/family1/b3e463576bc240c08dfb0ca03d4a5cb3 2023-02-09 16:56:22,864 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/.tmp/family1/56292a2434d84873aa507253e1653d6b as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/family1/56292a2434d84873aa507253e1653d6b 2023-02-09 16:56:22,896 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/family1/b3e463576bc240c08dfb0ca03d4a5cb3, entries=4, sequenceid=17, filesize=5.5 K 2023-02-09 16:56:22,897 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/family1/56292a2434d84873aa507253e1653d6b, entries=4, sequenceid=17, filesize=5.5 K 2023-02-09 16:56:22,898 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/.tmp/family2/bf9b9699eceb456fa355845444a1c11a as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/family2/bf9b9699eceb456fa355845444a1c11a 2023-02-09 16:56:22,899 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/.tmp/family2/718a9fd6fe9f420eaf17cfe57ac51091 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/family2/718a9fd6fe9f420eaf17cfe57ac51091 2023-02-09 16:56:22,906 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/family2/718a9fd6fe9f420eaf17cfe57ac51091, entries=2, sequenceid=17, filesize=5.1 K 2023-02-09 16:56:22,907 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/family2/bf9b9699eceb456fa355845444a1c11a, entries=2, sequenceid=17, filesize=5.1 K 2023-02-09 16:56:22,907 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for b6642b7af52cdcee8a7a96045bffa7ab in 1365ms, sequenceid=17, compaction requested=true 2023-02-09 16:56:22,907 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for b6642b7af52cdcee8a7a96045bffa7ab: 2023-02-09 16:56:22,907 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1675961774139.b6642b7af52cdcee8a7a96045bffa7ab. 2023-02-09 16:56:22,907 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-09 16:56:22,907 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 372e344ee104159de14194bcc979bbc2 in 1365ms, sequenceid=17, compaction requested=true 2023-02-09 16:56:22,908 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 372e344ee104159de14194bcc979bbc2: 2023-02-09 16:56:22,908 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1675961774139.372e344ee104159de14194bcc979bbc2. 2023-02-09 16:56:22,908 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-09 16:56:23,255 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/.tmp/family2/8091df1b69e5475ebb9fae797a43082a 2023-02-09 16:56:23,259 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/.tmp/family1/e8e87291fd3e42a8a484c96d35d448c5 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/family1/e8e87291fd3e42a8a484c96d35d448c5 2023-02-09 16:56:23,283 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/family1/e8e87291fd3e42a8a484c96d35d448c5, entries=4, sequenceid=17, filesize=5.5 K 2023-02-09 16:56:23,283 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/.tmp/family2/8091df1b69e5475ebb9fae797a43082a as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/family2/8091df1b69e5475ebb9fae797a43082a 2023-02-09 16:56:23,287 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/family2/8091df1b69e5475ebb9fae797a43082a, entries=2, sequenceid=17, filesize=5.1 K 2023-02-09 16:56:23,287 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for cb9647e274752929ab251cba8aca91a8 in 1745ms, sequenceid=17, compaction requested=true 2023-02-09 16:56:23,288 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for cb9647e274752929ab251cba8aca91a8: 2023-02-09 16:56:23,288 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1675961774139.cb9647e274752929ab251cba8aca91a8. 2023-02-09 16:56:23,288 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-09 16:56:23,288 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-09 16:56:23,288 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:23,288 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-02-09 16:56:23,288 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-02-09 16:56:23,289 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:23,289 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 16:56:23,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:23,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:56:23,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:56:23,290 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 16:56:23,290 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:56:23,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:56:23,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:56:23,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 16:56:23,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:23,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:56:23,291 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-02-09 16:56:23,291 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3ace2f13[Count = 0] remaining members to acquire global barrier 2023-02-09 16:56:23,291 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-02-09 16:56:23,291 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 16:56:23,293 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 16:56:23,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 16:56:23,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 16:56:23,294 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-02-09 16:56:23,294 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-02-09 16:56:23,294 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:56:23,294 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:23,294 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:56:23,295 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-02-09 16:56:23,295 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:23,295 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:56:23,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:23,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:56:23,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:56:23,295 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-02-09 16:56:23,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:56:23,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:56:23,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 16:56:23,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:23,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:56:23,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 16:56:23,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:23,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:56:23,297 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-02-09 16:56:23,297 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-02-09 16:56:23,297 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:56:23,297 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:56:23,297 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-02-09 16:56:23,297 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:56:23,298 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 16:56:23,298 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 16:56:23,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 16:56:23,298 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 16:56:23,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 16:56:23,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:56:23,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:56:23,298 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:56:23,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:56:23,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:56:23,299 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:23,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:56:23,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 16:56:23,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 16:56:23,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:56:23,300 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:23,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 16:56:23,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:23,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:56:23,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 16:56:23,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:23,302 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:23,302 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-09 16:56:23,302 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-09 16:56:23,302 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:56:23,302 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:56:23,302 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:56:23,302 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:23,302 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-02-09 16:56:23,302 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:56:23,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:56:23,302 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 16:56:23,302 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 16:56:23,302 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-02-09 16:56:23,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:56:23,302 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-02-09 16:56:23,302 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 16:56:23,302 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:56:23,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:56:23,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:56:23,403 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:56:23,403 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:56:23,403 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:56:23,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:56:23,413 DEBUG [Listener at localhost/41619] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-09 16:56:23,420 DEBUG [Listener at localhost/41619] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-09 16:56:23,429 DEBUG [Listener at localhost/41619] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-09 16:56:23,430 DEBUG [Listener at localhost/41619] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-09 16:56:23,516 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:56:23,516 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:56:23,516 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 16:56:23,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-02-09 16:56:23,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-02-09 16:56:23,518 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-02-09 16:56:23,518 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:56:23,518 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-02-09 16:56:23,518 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-02-09 16:56:23,519 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 16:56:23,519 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-09 16:56:23,521 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:56:23,521 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:23,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:56:23,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:56:23,521 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:23,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-09 16:56:23,522 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 16:56:23,522 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 16:56:23,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 16:56:23,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-09 16:56:23,522 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-02-09 16:56:23,525 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-02-09 16:56:23,525 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-02-09 16:56:23,526 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-02-09 16:56:23,526 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 16:56:23,526 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-02-09 16:56:23,526 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1675961774139.b6642b7af52cdcee8a7a96045bffa7ab. 2023-02-09 16:56:23,526 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1675961774139.b6642b7af52cdcee8a7a96045bffa7ab. started... 2023-02-09 16:56:23,526 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-09 16:56:23,526 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 16:56:23,526 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing b6642b7af52cdcee8a7a96045bffa7ab 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-09 16:56:23,526 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1675961774139.cb9647e274752929ab251cba8aca91a8. 2023-02-09 16:56:23,526 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1675961774139.372e344ee104159de14194bcc979bbc2. 2023-02-09 16:56:23,526 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1675961774139.cb9647e274752929ab251cba8aca91a8. started... 2023-02-09 16:56:23,526 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1675961774139.372e344ee104159de14194bcc979bbc2. started... 2023-02-09 16:56:23,526 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing cb9647e274752929ab251cba8aca91a8 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-09 16:56:23,526 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 372e344ee104159de14194bcc979bbc2 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-09 16:56:23,963 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/.tmp/family1/7b05a927bae64ceaa7cec62757b872cf 2023-02-09 16:56:23,968 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/.tmp/family1/ed83b93ebdb84e4681faed856a26abf6 2023-02-09 16:56:23,969 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/.tmp/family1/a8640d8b43c24e66812a0cbcb674f78e 2023-02-09 16:56:23,993 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7b05a927bae64ceaa7cec62757b872cf 2023-02-09 16:56:23,996 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a8640d8b43c24e66812a0cbcb674f78e 2023-02-09 16:56:23,999 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ed83b93ebdb84e4681faed856a26abf6 2023-02-09 16:56:24,010 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/.tmp/family2/f0972974bd004997b96c6f3392662017 2023-02-09 16:56:24,013 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f0972974bd004997b96c6f3392662017 2023-02-09 16:56:24,014 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/.tmp/family1/a8640d8b43c24e66812a0cbcb674f78e as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/family1/a8640d8b43c24e66812a0cbcb674f78e 2023-02-09 16:56:24,036 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a8640d8b43c24e66812a0cbcb674f78e 2023-02-09 16:56:24,037 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/family1/a8640d8b43c24e66812a0cbcb674f78e, entries=3, sequenceid=23, filesize=5.2 K 2023-02-09 16:56:24,037 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/.tmp/family2/f0972974bd004997b96c6f3392662017 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/family2/f0972974bd004997b96c6f3392662017 2023-02-09 16:56:24,040 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f0972974bd004997b96c6f3392662017 2023-02-09 16:56:24,040 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/family2/f0972974bd004997b96c6f3392662017, entries=1, sequenceid=23, filesize=5.0 K 2023-02-09 16:56:24,041 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for cb9647e274752929ab251cba8aca91a8 in 515ms, sequenceid=23, compaction requested=true 2023-02-09 16:56:24,041 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for cb9647e274752929ab251cba8aca91a8: 2023-02-09 16:56:24,041 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1675961774139.cb9647e274752929ab251cba8aca91a8. 2023-02-09 16:56:24,041 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-09 16:56:24,409 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/.tmp/family2/c10e0e2ea58d4106855ab2d0292dbd6a 2023-02-09 16:56:24,413 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/.tmp/family2/14476eecf37943e1bba37a67cfd518f8 2023-02-09 16:56:24,413 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c10e0e2ea58d4106855ab2d0292dbd6a 2023-02-09 16:56:24,414 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/.tmp/family1/7b05a927bae64ceaa7cec62757b872cf as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/family1/7b05a927bae64ceaa7cec62757b872cf 2023-02-09 16:56:24,416 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 14476eecf37943e1bba37a67cfd518f8 2023-02-09 16:56:24,416 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/.tmp/family1/ed83b93ebdb84e4681faed856a26abf6 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/family1/ed83b93ebdb84e4681faed856a26abf6 2023-02-09 16:56:24,437 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7b05a927bae64ceaa7cec62757b872cf 2023-02-09 16:56:24,437 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/family1/7b05a927bae64ceaa7cec62757b872cf, entries=3, sequenceid=23, filesize=5.2 K 2023-02-09 16:56:24,438 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ed83b93ebdb84e4681faed856a26abf6 2023-02-09 16:56:24,438 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/family1/ed83b93ebdb84e4681faed856a26abf6, entries=3, sequenceid=23, filesize=5.2 K 2023-02-09 16:56:24,438 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/.tmp/family2/c10e0e2ea58d4106855ab2d0292dbd6a as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/family2/c10e0e2ea58d4106855ab2d0292dbd6a 2023-02-09 16:56:24,439 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/.tmp/family2/14476eecf37943e1bba37a67cfd518f8 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/family2/14476eecf37943e1bba37a67cfd518f8 2023-02-09 16:56:24,442 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c10e0e2ea58d4106855ab2d0292dbd6a 2023-02-09 16:56:24,442 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 14476eecf37943e1bba37a67cfd518f8 2023-02-09 16:56:24,442 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/family2/c10e0e2ea58d4106855ab2d0292dbd6a, entries=1, sequenceid=23, filesize=5.0 K 2023-02-09 16:56:24,442 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/family2/14476eecf37943e1bba37a67cfd518f8, entries=1, sequenceid=23, filesize=5.0 K 2023-02-09 16:56:24,443 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for b6642b7af52cdcee8a7a96045bffa7ab in 917ms, sequenceid=23, compaction requested=true 2023-02-09 16:56:24,443 INFO [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 372e344ee104159de14194bcc979bbc2 in 917ms, sequenceid=23, compaction requested=true 2023-02-09 16:56:24,443 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 372e344ee104159de14194bcc979bbc2: 2023-02-09 16:56:24,443 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for b6642b7af52cdcee8a7a96045bffa7ab: 2023-02-09 16:56:24,443 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1675961774139.372e344ee104159de14194bcc979bbc2. 2023-02-09 16:56:24,443 DEBUG [rs(jenkins-hbase4.apache.org,35511,1675961620699)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1675961774139.b6642b7af52cdcee8a7a96045bffa7ab. 2023-02-09 16:56:24,443 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-09 16:56:24,443 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-09 16:56:24,443 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-09 16:56:24,443 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:24,443 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-02-09 16:56:24,444 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-02-09 16:56:24,445 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:24,445 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 16:56:24,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:24,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:56:24,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:56:24,445 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 16:56:24,445 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 16:56:24,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:56:24,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:56:24,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 16:56:24,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:24,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:56:24,447 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35511,1675961620699' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-02-09 16:56:24,447 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@63e56933[Count = 0] remaining members to acquire global barrier 2023-02-09 16:56:24,447 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-02-09 16:56:24,447 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 16:56:24,448 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 16:56:24,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 16:56:24,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 16:56:24,448 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-02-09 16:56:24,448 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-02-09 16:56:24,448 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,35511,1675961620699' in zk 2023-02-09 16:56:24,448 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:24,448 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 16:56:24,449 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:24,449 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-02-09 16:56:24,449 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:56:24,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:24,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:56:24,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:56:24,449 DEBUG [member: 'jenkins-hbase4.apache.org,35511,1675961620699' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-02-09 16:56:24,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:56:24,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:56:24,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 16:56:24,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:24,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:56:24,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 16:56:24,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:24,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,35511,1675961620699': 2023-02-09 16:56:24,451 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35511,1675961620699' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-02-09 16:56:24,451 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-02-09 16:56:24,451 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 16:56:24,451 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 16:56:24,451 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-02-09 16:56:24,451 INFO [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 16:56:24,454 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 16:56:24,454 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 16:56:24,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 16:56:24,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 16:56:24,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 16:56:24,454 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 16:56:24,454 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:56:24,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 16:56:24,454 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:24,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 16:56:24,454 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:56:24,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:56:24,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 16:56:24,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 16:56:24,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 16:56:24,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 16:56:24,455 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:24,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:24,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 16:56:24,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 16:56:24,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:24,457 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:24,457 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-09 16:56:24,457 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 16:56:24,457 DEBUG [(jenkins-hbase4.apache.org,41333,1675961619562)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 16:56:24,457 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-09 16:56:24,457 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 16:56:24,457 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 16:56:24,457 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-02-09 16:56:24,458 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 16:56:24,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 16:56:24,457 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:24,458 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 16:56:24,458 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 16:56:24,458 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 16:56:24,458 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-02-09 16:56:24,458 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 16:56:24,458 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-02-09 16:56:24,458 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 16:56:24,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 16:56:24,558 DEBUG [Listener at localhost/41619] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 16:56:24,558 INFO [Listener at localhost/41619] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:56:24,558 INFO [Listener at localhost/41619] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:56:24,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41333] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 16:56:24,559 DEBUG [Listener at localhost/41619] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-09 16:56:24,560 DEBUG [Listener at localhost/41619] regionserver.HStore(1912): b6642b7af52cdcee8a7a96045bffa7ab/family1 is initiating major compaction (all files) 2023-02-09 16:56:24,560 INFO [Listener at localhost/41619] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 16:56:24,560 INFO [Listener at localhost/41619] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 16:56:24,561 INFO [Listener at localhost/41619] regionserver.HRegion(2258): Starting compaction of b6642b7af52cdcee8a7a96045bffa7ab/family1 in testMajorCompactionFromAdmin,1,1675961774139.b6642b7af52cdcee8a7a96045bffa7ab. 2023-02-09 16:56:24,561 INFO [Listener at localhost/41619] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/family1/4d7fc49b664c4b1bb12aa7ab2f309128, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/family1/4349a6505e80472e84cf9ae1337eb2c1, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/family1/ed198d32849142f7997552f866f212ab, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/family1/56292a2434d84873aa507253e1653d6b, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/family1/7b05a927bae64ceaa7cec62757b872cf] into tmpdir=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/.tmp, totalSize=27.1 K 2023-02-09 16:56:24,562 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting 4d7fc49b664c4b1bb12aa7ab2f309128, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675961776284 2023-02-09 16:56:24,562 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting 4349a6505e80472e84cf9ae1337eb2c1, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675961778163 2023-02-09 16:56:24,562 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting ed198d32849142f7997552f866f212ab, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675961780036 2023-02-09 16:56:24,563 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting 56292a2434d84873aa507253e1653d6b, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675961781528 2023-02-09 16:56:24,563 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting 7b05a927bae64ceaa7cec62757b872cf, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-09 16:56:24,574 INFO [Listener at localhost/41619] throttle.PressureAwareThroughputController(145): b6642b7af52cdcee8a7a96045bffa7ab#family1#compaction#198 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 16:56:25,013 INFO [Listener at localhost/41619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023020923cb18279944429597e25dad9e68319c_del 2023-02-09 16:56:25,013 INFO [Listener at localhost/41619] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023020923cb18279944429597e25dad9e68319c_del to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023020923cb18279944429597e25dad9e68319c_del 2023-02-09 16:56:25,874 INFO [Listener at localhost/41619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e626c50a97bb43949b1019a0742ef1b8 2023-02-09 16:56:25,875 DEBUG [Listener at localhost/41619] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/.tmp/family1/e626c50a97bb43949b1019a0742ef1b8 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/family1/e626c50a97bb43949b1019a0742ef1b8 2023-02-09 16:56:25,899 INFO [Listener at localhost/41619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e626c50a97bb43949b1019a0742ef1b8 2023-02-09 16:56:25,899 INFO [Listener at localhost/41619] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in b6642b7af52cdcee8a7a96045bffa7ab/family1 of b6642b7af52cdcee8a7a96045bffa7ab into e626c50a97bb43949b1019a0742ef1b8(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-09 16:56:25,900 DEBUG [Listener at localhost/41619] regionserver.HRegion(2288): Compaction status journal for b6642b7af52cdcee8a7a96045bffa7ab: 2023-02-09 16:56:25,900 DEBUG [Listener at localhost/41619] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-09 16:56:25,900 DEBUG [Listener at localhost/41619] regionserver.HStore(1912): b6642b7af52cdcee8a7a96045bffa7ab/family2 is initiating major compaction (all files) 2023-02-09 16:56:25,900 INFO [Listener at localhost/41619] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 16:56:25,900 INFO [Listener at localhost/41619] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 16:56:25,900 INFO [Listener at localhost/41619] regionserver.HRegion(2258): Starting compaction of b6642b7af52cdcee8a7a96045bffa7ab/family2 in testMajorCompactionFromAdmin,1,1675961774139.b6642b7af52cdcee8a7a96045bffa7ab. 2023-02-09 16:56:25,900 INFO [Listener at localhost/41619] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/family2/b66eecbfe13a49de92e1c8293649c33e, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/family2/c28e4590fd3747e0800a9be6612c414a, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/family2/27d71aa6d0f448ae8470c89907c993e4, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/family2/718a9fd6fe9f420eaf17cfe57ac51091, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/family2/c10e0e2ea58d4106855ab2d0292dbd6a] into tmpdir=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/.tmp, totalSize=25.4 K 2023-02-09 16:56:25,901 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting b66eecbfe13a49de92e1c8293649c33e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675961776284 2023-02-09 16:56:25,901 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting c28e4590fd3747e0800a9be6612c414a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675961778163 2023-02-09 16:56:25,901 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting 27d71aa6d0f448ae8470c89907c993e4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675961780036 2023-02-09 16:56:25,901 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting 718a9fd6fe9f420eaf17cfe57ac51091, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675961781528 2023-02-09 16:56:25,902 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting c10e0e2ea58d4106855ab2d0292dbd6a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-09 16:56:25,908 INFO [Listener at localhost/41619] throttle.PressureAwareThroughputController(145): b6642b7af52cdcee8a7a96045bffa7ab#family2#compaction#199 average throughput is 1.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 16:56:25,985 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/family1/4d7fc49b664c4b1bb12aa7ab2f309128, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/family1/4349a6505e80472e84cf9ae1337eb2c1, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/family1/ed198d32849142f7997552f866f212ab, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/family1/56292a2434d84873aa507253e1653d6b, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/family1/7b05a927bae64ceaa7cec62757b872cf] to archive 2023-02-09 16:56:25,986 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 16:56:25,988 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/family1/4d7fc49b664c4b1bb12aa7ab2f309128 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/family1/4d7fc49b664c4b1bb12aa7ab2f309128 2023-02-09 16:56:25,989 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/family1/4349a6505e80472e84cf9ae1337eb2c1 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/family1/4349a6505e80472e84cf9ae1337eb2c1 2023-02-09 16:56:25,990 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/family1/ed198d32849142f7997552f866f212ab to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/family1/ed198d32849142f7997552f866f212ab 2023-02-09 16:56:25,991 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/family1/56292a2434d84873aa507253e1653d6b to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/family1/56292a2434d84873aa507253e1653d6b 2023-02-09 16:56:25,992 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/family1/7b05a927bae64ceaa7cec62757b872cf to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/family1/7b05a927bae64ceaa7cec62757b872cf 2023-02-09 16:56:26,317 INFO [Listener at localhost/41619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230209b582c77aa1874ed7a6c0f1f04954cf7a_del 2023-02-09 16:56:26,317 INFO [Listener at localhost/41619] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230209b582c77aa1874ed7a6c0f1f04954cf7a_del to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20230209b582c77aa1874ed7a6c0f1f04954cf7a_del 2023-02-09 16:56:27,129 INFO [Listener at localhost/41619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 80613b39e4a743c9902db5e6efcdbf20 2023-02-09 16:56:27,129 DEBUG [Listener at localhost/41619] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/.tmp/family2/80613b39e4a743c9902db5e6efcdbf20 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/family2/80613b39e4a743c9902db5e6efcdbf20 2023-02-09 16:56:27,132 INFO [Listener at localhost/41619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 80613b39e4a743c9902db5e6efcdbf20 2023-02-09 16:56:27,133 INFO [Listener at localhost/41619] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in b6642b7af52cdcee8a7a96045bffa7ab/family2 of b6642b7af52cdcee8a7a96045bffa7ab into 80613b39e4a743c9902db5e6efcdbf20(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-09 16:56:27,133 DEBUG [Listener at localhost/41619] regionserver.HRegion(2288): Compaction status journal for b6642b7af52cdcee8a7a96045bffa7ab: 2023-02-09 16:56:27,133 DEBUG [Listener at localhost/41619] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-09 16:56:27,134 DEBUG [Listener at localhost/41619] regionserver.HStore(1912): cb9647e274752929ab251cba8aca91a8/family1 is initiating major compaction (all files) 2023-02-09 16:56:27,134 INFO [Listener at localhost/41619] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 16:56:27,134 INFO [Listener at localhost/41619] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 16:56:27,134 INFO [Listener at localhost/41619] regionserver.HRegion(2258): Starting compaction of cb9647e274752929ab251cba8aca91a8/family1 in testMajorCompactionFromAdmin,2,1675961774139.cb9647e274752929ab251cba8aca91a8. 2023-02-09 16:56:27,134 INFO [Listener at localhost/41619] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/family1/699048a830864852905bb5ff52187c24, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/family1/cd1564701b334d4191808882717bbc3a, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/family1/d40889a1900a4d029ec6c6ea284ada6d, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/family1/e8e87291fd3e42a8a484c96d35d448c5, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/family1/a8640d8b43c24e66812a0cbcb674f78e] into tmpdir=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/.tmp, totalSize=27.1 K 2023-02-09 16:56:27,135 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting 699048a830864852905bb5ff52187c24, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675961776284 2023-02-09 16:56:27,135 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting cd1564701b334d4191808882717bbc3a, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675961778163 2023-02-09 16:56:27,135 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting d40889a1900a4d029ec6c6ea284ada6d, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675961780036 2023-02-09 16:56:27,136 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting e8e87291fd3e42a8a484c96d35d448c5, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675961781529 2023-02-09 16:56:27,136 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting a8640d8b43c24e66812a0cbcb674f78e, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-09 16:56:27,143 INFO [Listener at localhost/41619] throttle.PressureAwareThroughputController(145): cb9647e274752929ab251cba8aca91a8#family1#compaction#200 average throughput is 1.72 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 16:56:27,185 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/family2/b66eecbfe13a49de92e1c8293649c33e, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/family2/c28e4590fd3747e0800a9be6612c414a, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/family2/27d71aa6d0f448ae8470c89907c993e4, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/family2/718a9fd6fe9f420eaf17cfe57ac51091, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/family2/c10e0e2ea58d4106855ab2d0292dbd6a] to archive 2023-02-09 16:56:27,186 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 16:56:27,188 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/family2/b66eecbfe13a49de92e1c8293649c33e to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/family2/b66eecbfe13a49de92e1c8293649c33e 2023-02-09 16:56:27,189 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/family2/c28e4590fd3747e0800a9be6612c414a to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/family2/c28e4590fd3747e0800a9be6612c414a 2023-02-09 16:56:27,190 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/family2/27d71aa6d0f448ae8470c89907c993e4 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/family2/27d71aa6d0f448ae8470c89907c993e4 2023-02-09 16:56:27,191 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/family2/718a9fd6fe9f420eaf17cfe57ac51091 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/family2/718a9fd6fe9f420eaf17cfe57ac51091 2023-02-09 16:56:27,192 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/family2/c10e0e2ea58d4106855ab2d0292dbd6a to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/family2/c10e0e2ea58d4106855ab2d0292dbd6a 2023-02-09 16:56:27,587 INFO [Listener at localhost/41619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202302093f8d2e21a36243db873ecd13f1ff359c_del 2023-02-09 16:56:27,587 INFO [Listener at localhost/41619] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302093f8d2e21a36243db873ecd13f1ff359c_del to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302093f8d2e21a36243db873ecd13f1ff359c_del 2023-02-09 16:56:28,450 INFO [Listener at localhost/41619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5d2812e6de8848f59ed7dd3c1f16308e 2023-02-09 16:56:28,451 DEBUG [Listener at localhost/41619] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/.tmp/family1/5d2812e6de8848f59ed7dd3c1f16308e as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/family1/5d2812e6de8848f59ed7dd3c1f16308e 2023-02-09 16:56:28,473 INFO [Listener at localhost/41619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5d2812e6de8848f59ed7dd3c1f16308e 2023-02-09 16:56:28,474 INFO [Listener at localhost/41619] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in cb9647e274752929ab251cba8aca91a8/family1 of cb9647e274752929ab251cba8aca91a8 into 5d2812e6de8848f59ed7dd3c1f16308e(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-09 16:56:28,474 DEBUG [Listener at localhost/41619] regionserver.HRegion(2288): Compaction status journal for cb9647e274752929ab251cba8aca91a8: 2023-02-09 16:56:28,474 DEBUG [Listener at localhost/41619] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-09 16:56:28,474 DEBUG [Listener at localhost/41619] regionserver.HStore(1912): cb9647e274752929ab251cba8aca91a8/family2 is initiating major compaction (all files) 2023-02-09 16:56:28,474 INFO [Listener at localhost/41619] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 16:56:28,474 INFO [Listener at localhost/41619] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 16:56:28,476 INFO [Listener at localhost/41619] regionserver.HRegion(2258): Starting compaction of cb9647e274752929ab251cba8aca91a8/family2 in testMajorCompactionFromAdmin,2,1675961774139.cb9647e274752929ab251cba8aca91a8. 2023-02-09 16:56:28,476 INFO [Listener at localhost/41619] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/family2/940989463eae401999ff5fb039e53b07, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/family2/62e62ff835414f669699e5b5ed7a1d29, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/family2/0ab4bdabb26e40ffadf5a4057832cce2, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/family2/8091df1b69e5475ebb9fae797a43082a, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/family2/f0972974bd004997b96c6f3392662017] into tmpdir=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/.tmp, totalSize=25.4 K 2023-02-09 16:56:28,476 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting 940989463eae401999ff5fb039e53b07, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675961776284 2023-02-09 16:56:28,477 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting 62e62ff835414f669699e5b5ed7a1d29, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675961778163 2023-02-09 16:56:28,477 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting 0ab4bdabb26e40ffadf5a4057832cce2, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675961780036 2023-02-09 16:56:28,477 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting 8091df1b69e5475ebb9fae797a43082a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675961781529 2023-02-09 16:56:28,478 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting f0972974bd004997b96c6f3392662017, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-09 16:56:28,485 INFO [Listener at localhost/41619] throttle.PressureAwareThroughputController(145): cb9647e274752929ab251cba8aca91a8#family2#compaction#201 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 16:56:28,486 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/family1/699048a830864852905bb5ff52187c24, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/family1/cd1564701b334d4191808882717bbc3a, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/family1/d40889a1900a4d029ec6c6ea284ada6d, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/family1/e8e87291fd3e42a8a484c96d35d448c5, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/family1/a8640d8b43c24e66812a0cbcb674f78e] to archive 2023-02-09 16:56:28,486 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 16:56:28,488 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/family1/699048a830864852905bb5ff52187c24 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/family1/699048a830864852905bb5ff52187c24 2023-02-09 16:56:28,489 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/family1/cd1564701b334d4191808882717bbc3a to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/family1/cd1564701b334d4191808882717bbc3a 2023-02-09 16:56:28,490 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/family1/d40889a1900a4d029ec6c6ea284ada6d to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/family1/d40889a1900a4d029ec6c6ea284ada6d 2023-02-09 16:56:28,491 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/family1/e8e87291fd3e42a8a484c96d35d448c5 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/family1/e8e87291fd3e42a8a484c96d35d448c5 2023-02-09 16:56:28,491 INFO [Listener at localhost/41619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202302096c011e9d9f7040fdba16dd7f3c811d35_del 2023-02-09 16:56:28,492 INFO [Listener at localhost/41619] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302096c011e9d9f7040fdba16dd7f3c811d35_del to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202302096c011e9d9f7040fdba16dd7f3c811d35_del 2023-02-09 16:56:28,492 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/family1/a8640d8b43c24e66812a0cbcb674f78e to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/family1/a8640d8b43c24e66812a0cbcb674f78e 2023-02-09 16:56:29,305 INFO [Listener at localhost/41619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5832b35247e24314a3e2526f8c7007f6 2023-02-09 16:56:29,306 DEBUG [Listener at localhost/41619] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/.tmp/family2/5832b35247e24314a3e2526f8c7007f6 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/family2/5832b35247e24314a3e2526f8c7007f6 2023-02-09 16:56:29,309 INFO [Listener at localhost/41619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5832b35247e24314a3e2526f8c7007f6 2023-02-09 16:56:29,310 INFO [Listener at localhost/41619] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in cb9647e274752929ab251cba8aca91a8/family2 of cb9647e274752929ab251cba8aca91a8 into 5832b35247e24314a3e2526f8c7007f6(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-09 16:56:29,311 DEBUG [Listener at localhost/41619] regionserver.HRegion(2288): Compaction status journal for cb9647e274752929ab251cba8aca91a8: 2023-02-09 16:56:29,311 DEBUG [Listener at localhost/41619] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-09 16:56:29,311 DEBUG [Listener at localhost/41619] regionserver.HStore(1912): 372e344ee104159de14194bcc979bbc2/family1 is initiating major compaction (all files) 2023-02-09 16:56:29,311 INFO [Listener at localhost/41619] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 16:56:29,311 INFO [Listener at localhost/41619] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 16:56:29,312 INFO [Listener at localhost/41619] regionserver.HRegion(2258): Starting compaction of 372e344ee104159de14194bcc979bbc2/family1 in testMajorCompactionFromAdmin,,1675961774139.372e344ee104159de14194bcc979bbc2. 2023-02-09 16:56:29,312 INFO [Listener at localhost/41619] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/family1/28ef5911823845dda0b9a046980d76c0, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/family1/f824cc7da99c40098f639dca8b2fd26f, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/family1/a392de2b239e4c33b92ddbfdf2269edf, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/family1/b3e463576bc240c08dfb0ca03d4a5cb3, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/family1/ed83b93ebdb84e4681faed856a26abf6] into tmpdir=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/.tmp, totalSize=27.1 K 2023-02-09 16:56:29,313 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting 28ef5911823845dda0b9a046980d76c0, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675961776283 2023-02-09 16:56:29,313 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting f824cc7da99c40098f639dca8b2fd26f, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675961778163 2023-02-09 16:56:29,313 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting a392de2b239e4c33b92ddbfdf2269edf, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675961780036 2023-02-09 16:56:29,314 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting b3e463576bc240c08dfb0ca03d4a5cb3, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675961781528 2023-02-09 16:56:29,314 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting ed83b93ebdb84e4681faed856a26abf6, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-09 16:56:29,322 INFO [Listener at localhost/41619] throttle.PressureAwareThroughputController(145): 372e344ee104159de14194bcc979bbc2#family1#compaction#202 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 16:56:29,361 INFO [Listener at localhost/41619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202302093291302d624d4dc48bd88407fc7dfa27_del 2023-02-09 16:56:29,361 INFO [Listener at localhost/41619] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302093291302d624d4dc48bd88407fc7dfa27_del to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302093291302d624d4dc48bd88407fc7dfa27_del 2023-02-09 16:56:29,390 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/family2/940989463eae401999ff5fb039e53b07, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/family2/62e62ff835414f669699e5b5ed7a1d29, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/family2/0ab4bdabb26e40ffadf5a4057832cce2, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/family2/8091df1b69e5475ebb9fae797a43082a, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/family2/f0972974bd004997b96c6f3392662017] to archive 2023-02-09 16:56:29,390 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 16:56:29,392 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/family2/940989463eae401999ff5fb039e53b07 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/family2/940989463eae401999ff5fb039e53b07 2023-02-09 16:56:29,393 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/family2/62e62ff835414f669699e5b5ed7a1d29 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/family2/62e62ff835414f669699e5b5ed7a1d29 2023-02-09 16:56:29,394 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/family2/0ab4bdabb26e40ffadf5a4057832cce2 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/family2/0ab4bdabb26e40ffadf5a4057832cce2 2023-02-09 16:56:29,395 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/family2/8091df1b69e5475ebb9fae797a43082a to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/family2/8091df1b69e5475ebb9fae797a43082a 2023-02-09 16:56:29,395 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/family2/f0972974bd004997b96c6f3392662017 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/family2/f0972974bd004997b96c6f3392662017 2023-02-09 16:56:30,219 INFO [Listener at localhost/41619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d16c13a28acc448bad4cf4f386da1ab4 2023-02-09 16:56:30,220 DEBUG [Listener at localhost/41619] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/.tmp/family1/d16c13a28acc448bad4cf4f386da1ab4 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/family1/d16c13a28acc448bad4cf4f386da1ab4 2023-02-09 16:56:30,242 INFO [Listener at localhost/41619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d16c13a28acc448bad4cf4f386da1ab4 2023-02-09 16:56:30,257 INFO [Listener at localhost/41619] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 372e344ee104159de14194bcc979bbc2/family1 of 372e344ee104159de14194bcc979bbc2 into d16c13a28acc448bad4cf4f386da1ab4(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-09 16:56:30,258 DEBUG [Listener at localhost/41619] regionserver.HRegion(2288): Compaction status journal for 372e344ee104159de14194bcc979bbc2: 2023-02-09 16:56:30,258 DEBUG [Listener at localhost/41619] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-09 16:56:30,258 DEBUG [Listener at localhost/41619] regionserver.HStore(1912): 372e344ee104159de14194bcc979bbc2/family2 is initiating major compaction (all files) 2023-02-09 16:56:30,258 INFO [Listener at localhost/41619] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 16:56:30,258 INFO [Listener at localhost/41619] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 16:56:30,258 INFO [Listener at localhost/41619] regionserver.HRegion(2258): Starting compaction of 372e344ee104159de14194bcc979bbc2/family2 in testMajorCompactionFromAdmin,,1675961774139.372e344ee104159de14194bcc979bbc2. 2023-02-09 16:56:30,258 INFO [Listener at localhost/41619] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/family2/b25c52f5e23e49a2bec401c46b5f932b, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/family2/a09fc31e512a480c9969437844f1ad15, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/family2/cce886f918f04a05a5c34ad7aabf71cf, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/family2/bf9b9699eceb456fa355845444a1c11a, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/family2/14476eecf37943e1bba37a67cfd518f8] into tmpdir=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/.tmp, totalSize=25.4 K 2023-02-09 16:56:30,259 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting b25c52f5e23e49a2bec401c46b5f932b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675961776283 2023-02-09 16:56:30,259 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting a09fc31e512a480c9969437844f1ad15, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675961778163 2023-02-09 16:56:30,260 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting cce886f918f04a05a5c34ad7aabf71cf, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675961780036 2023-02-09 16:56:30,260 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-09 16:56:30,260 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2c41fa5d to 127.0.0.1:53887 2023-02-09 16:56:30,260 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 16:56:30,260 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting bf9b9699eceb456fa355845444a1c11a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675961781528 2023-02-09 16:56:30,261 DEBUG [Listener at localhost/41619] compactions.Compactor(207): Compacting 14476eecf37943e1bba37a67cfd518f8, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-09 16:56:30,270 INFO [Listener at localhost/41619] throttle.PressureAwareThroughputController(145): 372e344ee104159de14194bcc979bbc2#family2#compaction#203 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 16:56:30,286 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/family1/28ef5911823845dda0b9a046980d76c0, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/family1/f824cc7da99c40098f639dca8b2fd26f, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/family1/a392de2b239e4c33b92ddbfdf2269edf, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/family1/b3e463576bc240c08dfb0ca03d4a5cb3, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/family1/ed83b93ebdb84e4681faed856a26abf6] to archive 2023-02-09 16:56:30,287 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 16:56:30,288 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/family1/28ef5911823845dda0b9a046980d76c0 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/family1/28ef5911823845dda0b9a046980d76c0 2023-02-09 16:56:30,289 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/family1/f824cc7da99c40098f639dca8b2fd26f to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/family1/f824cc7da99c40098f639dca8b2fd26f 2023-02-09 16:56:30,290 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/family1/a392de2b239e4c33b92ddbfdf2269edf to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/family1/a392de2b239e4c33b92ddbfdf2269edf 2023-02-09 16:56:30,291 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/family1/b3e463576bc240c08dfb0ca03d4a5cb3 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/family1/b3e463576bc240c08dfb0ca03d4a5cb3 2023-02-09 16:56:30,291 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/family1/ed83b93ebdb84e4681faed856a26abf6 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/family1/ed83b93ebdb84e4681faed856a26abf6 2023-02-09 16:56:30,676 INFO [Listener at localhost/41619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023020948f1fbc5edc84b0bb5852004c40edc69_del 2023-02-09 16:56:30,677 INFO [Listener at localhost/41619] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023020948f1fbc5edc84b0bb5852004c40edc69_del to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e2023020948f1fbc5edc84b0bb5852004c40edc69_del 2023-02-09 16:56:31,489 INFO [Listener at localhost/41619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6ab9e1d7d607402aa530120f604be523 2023-02-09 16:56:31,490 DEBUG [Listener at localhost/41619] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/.tmp/family2/6ab9e1d7d607402aa530120f604be523 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/family2/6ab9e1d7d607402aa530120f604be523 2023-02-09 16:56:31,493 INFO [Listener at localhost/41619] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6ab9e1d7d607402aa530120f604be523 2023-02-09 16:56:31,494 INFO [Listener at localhost/41619] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 372e344ee104159de14194bcc979bbc2/family2 of 372e344ee104159de14194bcc979bbc2 into 6ab9e1d7d607402aa530120f604be523(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-09 16:56:31,494 DEBUG [Listener at localhost/41619] regionserver.HRegion(2288): Compaction status journal for 372e344ee104159de14194bcc979bbc2: 2023-02-09 16:56:31,497 DEBUG [Listener at localhost/41619] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-09 16:56:31,499 DEBUG [Listener at localhost/41619] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-09 16:56:31,502 DEBUG [Listener at localhost/41619] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-09 16:56:31,503 DEBUG [Listener at localhost/41619] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-09 16:56:31,508 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=41333] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10<\x0D\xF2`R\xB7M\xD8\x0B\x12\xFCst\x87\xAF\xF2"\x10P\x13\x8A\xA2\x1D\x80\x8C3\x88D\x99ZF\x0BA**\x10\xC4\xA5#D\x0F\x81`P\xFF\x86\xB6L\x9D\x1F\x06\x942\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testMajorCompactionFromAdmin 2023-02-09 16:56:31,528 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] procedure2.ProcedureExecutor(1029): Stored pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-02-09 16:56:31,529 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-02-09 16:56:31,530 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 16:56:31,530 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=123, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675962391530 2023-02-09 16:56:31,531 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-09 16:56:31,595 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/family2/b25c52f5e23e49a2bec401c46b5f932b, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/family2/a09fc31e512a480c9969437844f1ad15, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/family2/cce886f918f04a05a5c34ad7aabf71cf, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/family2/bf9b9699eceb456fa355845444a1c11a, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/family2/14476eecf37943e1bba37a67cfd518f8] to archive 2023-02-09 16:56:31,595 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 16:56:31,597 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/family2/b25c52f5e23e49a2bec401c46b5f932b to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/family2/b25c52f5e23e49a2bec401c46b5f932b 2023-02-09 16:56:31,598 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/family2/a09fc31e512a480c9969437844f1ad15 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/family2/a09fc31e512a480c9969437844f1ad15 2023-02-09 16:56:31,599 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/family2/cce886f918f04a05a5c34ad7aabf71cf to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/family2/cce886f918f04a05a5c34ad7aabf71cf 2023-02-09 16:56:31,600 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/family2/bf9b9699eceb456fa355845444a1c11a to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/family2/bf9b9699eceb456fa355845444a1c11a 2023-02-09 16:56:31,601 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/family2/14476eecf37943e1bba37a67cfd518f8 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/family2/14476eecf37943e1bba37a67cfd518f8 2023-02-09 16:56:31,860 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testMajorCompactionFromAdmin' and column 'family1' 2023-02-09 16:56:31,881 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202302093291302d624d4dc48bd88407fc7dfa27_del 2023-02-09 16:56:31,902 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023020923cb18279944429597e25dad9e68319c_del 2023-02-09 16:56:31,922 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202302093f8d2e21a36243db873ecd13f1ff359c_del 2023-02-09 16:56:31,922 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testMajorCompactionFromAdmin' column='family1' 2023-02-09 16:56:31,923 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] zookeeper.ReadOnlyZKClient(139): Connect 0x36b5e3dd to 127.0.0.1:53887 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 16:56:31,927 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@c4b7805, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 16:56:31,928 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230209 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-09 16:56:32,512 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230209861a70ee349e4139872cf304ef8f0856 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230209861a70ee349e4139872cf304ef8f0856 2023-02-09 16:56:32,512 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230209 table='testMajorCompactionFromAdmin' column='family1' 2023-02-09 16:56:32,524 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 16:56:32,526 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54076, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 16:56:32,532 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:56:32,532 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:56:32,533 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-09 16:56:32,535 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36356, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-09 16:56:32,562 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230209/family1/e35b387ee88a43ba9a375f1c077ccbd1 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-02-09 16:56:32,562 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionFromAdmin,2,1675961774139.cb9647e274752929ab251cba8aca91a8., hostname=jenkins-hbase4.apache.org,35511,1675961620699, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230209/family1/e35b387ee88a43ba9a375f1c077ccbd1}] 2023-02-09 16:56:32,567 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.HStore(763): Validating hfile at hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230209/family1/e35b387ee88a43ba9a375f1c077ccbd1 for inclusion in cb9647e274752929ab251cba8aca91a8/family1 2023-02-09 16:56:32,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-02-09 16:56:32,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.HStore(777): Region bounds: first=2 last= 2023-02-09 16:56:32,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.HRegion(2445): Flush status journal for cb9647e274752929ab251cba8aca91a8: 2023-02-09 16:56:32,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230209/family1/e35b387ee88a43ba9a375f1c077ccbd1 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionFromAdmin__uts14uur1ppr5p7kofj5f0l0qs1bh5ilpen69bc6js1su05sshq94mrvgd9vgeo0/family1/e35b387ee88a43ba9a375f1c077ccbd1 2023-02-09 16:56:32,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionFromAdmin__uts14uur1ppr5p7kofj5f0l0qs1bh5ilpen69bc6js1su05sshq94mrvgd9vgeo0/family1/e35b387ee88a43ba9a375f1c077ccbd1 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/family1/847bdc29600d4b4894e79daee8317aef_SeqId_28_ 2023-02-09 16:56:32,604 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.HStore(849): Loaded HFile hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionFromAdmin__uts14uur1ppr5p7kofj5f0l0qs1bh5ilpen69bc6js1su05sshq94mrvgd9vgeo0/family1/e35b387ee88a43ba9a375f1c077ccbd1 into cb9647e274752929ab251cba8aca91a8/family1 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/family1/847bdc29600d4b4894e79daee8317aef_SeqId_28_ - updating store file list. 2023-02-09 16:56:32,636 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.HStore(882): Loaded HFile hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/family1/847bdc29600d4b4894e79daee8317aef_SeqId_28_ into cb9647e274752929ab251cba8aca91a8/family1 2023-02-09 16:56:32,636 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.HStore(855): Successfully loaded hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionFromAdmin__uts14uur1ppr5p7kofj5f0l0qs1bh5ilpen69bc6js1su05sshq94mrvgd9vgeo0/family1/e35b387ee88a43ba9a375f1c077ccbd1 into cb9647e274752929ab251cba8aca91a8/family1 (new location: hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/family1/847bdc29600d4b4894e79daee8317aef_SeqId_28_) 2023-02-09 16:56:32,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionFromAdmin__uts14uur1ppr5p7kofj5f0l0qs1bh5ilpen69bc6js1su05sshq94mrvgd9vgeo0/family1/e35b387ee88a43ba9a375f1c077ccbd1 2023-02-09 16:56:32,639 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230209 table='testMajorCompactionFromAdmin' column='family1' 2023-02-09 16:56:32,639 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 16:56:32,640 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023020915cc3364bfd04e8984025d7b88518f74 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023020915cc3364bfd04e8984025d7b88518f74 2023-02-09 16:56:32,641 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302094cf172abf99c454e89caf583870cfdd4 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302094cf172abf99c454e89caf583870cfdd4 2023-02-09 16:56:32,642 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230209c9ea79d3f10d42e8928a86444f3e4451 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230209c9ea79d3f10d42e8928a86444f3e4451 2023-02-09 16:56:32,643 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230209da636ec90f9b4a47b65ee483e06c08ba to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230209da636ec90f9b4a47b65ee483e06c08ba 2023-02-09 16:56:32,643 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-02-09 16:56:32,643 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230209' 2023-02-09 16:56:32,643 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230209 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-09 16:56:32,643 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230209 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-09 16:56:33,296 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-02-09 16:56:33,587 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230209fa1e9b424405469daa30069fdccaa412 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230209fa1e9b424405469daa30069fdccaa412 2023-02-09 16:56:33,588 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230209 table='testMajorCompactionFromAdmin' column='family1' 2023-02-09 16:56:33,609 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:56:33,609 INFO [MobCompactor-pool-0] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:56:33,639 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230209/family1/47681c2ad8374c34af567b0db6bfa3e0 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-02-09 16:56:33,640 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionFromAdmin,,1675961774139.372e344ee104159de14194bcc979bbc2., hostname=jenkins-hbase4.apache.org,35511,1675961620699, seqNum=2 for row with hfile group [{family1,hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230209/family1/47681c2ad8374c34af567b0db6bfa3e0}] 2023-02-09 16:56:33,642 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.HStore(763): Validating hfile at hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230209/family1/47681c2ad8374c34af567b0db6bfa3e0 for inclusion in 372e344ee104159de14194bcc979bbc2/family1 2023-02-09 16:56:33,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-02-09 16:56:33,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.HStore(777): Region bounds: first= last=1 2023-02-09 16:56:33,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.HRegion(2445): Flush status journal for 372e344ee104159de14194bcc979bbc2: 2023-02-09 16:56:33,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230209/family1/47681c2ad8374c34af567b0db6bfa3e0 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionFromAdmin__9se3lr4215mlhraucqq6kp18au6bn047uao5u2ciu5e9tbqc86e01mrsuktstm1q/family1/47681c2ad8374c34af567b0db6bfa3e0 2023-02-09 16:56:33,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionFromAdmin__9se3lr4215mlhraucqq6kp18au6bn047uao5u2ciu5e9tbqc86e01mrsuktstm1q/family1/47681c2ad8374c34af567b0db6bfa3e0 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/family1/7f49b96016a843c395fd2a1890cc2461_SeqId_28_ 2023-02-09 16:56:33,666 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.HStore(849): Loaded HFile hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionFromAdmin__9se3lr4215mlhraucqq6kp18au6bn047uao5u2ciu5e9tbqc86e01mrsuktstm1q/family1/47681c2ad8374c34af567b0db6bfa3e0 into 372e344ee104159de14194bcc979bbc2/family1 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/family1/7f49b96016a843c395fd2a1890cc2461_SeqId_28_ - updating store file list. 2023-02-09 16:56:33,687 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.HStore(882): Loaded HFile hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/family1/7f49b96016a843c395fd2a1890cc2461_SeqId_28_ into 372e344ee104159de14194bcc979bbc2/family1 2023-02-09 16:56:33,687 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.HStore(855): Successfully loaded hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionFromAdmin__9se3lr4215mlhraucqq6kp18au6bn047uao5u2ciu5e9tbqc86e01mrsuktstm1q/family1/47681c2ad8374c34af567b0db6bfa3e0 into 372e344ee104159de14194bcc979bbc2/family1 (new location: hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/family1/7f49b96016a843c395fd2a1890cc2461_SeqId_28_) 2023-02-09 16:56:33,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionFromAdmin__9se3lr4215mlhraucqq6kp18au6bn047uao5u2ciu5e9tbqc86e01mrsuktstm1q/family1/47681c2ad8374c34af567b0db6bfa3e0 2023-02-09 16:56:33,689 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230209 table='testMajorCompactionFromAdmin' column='family1' 2023-02-09 16:56:33,689 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 16:56:33,691 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302098681e559df29460b915043ed5fc0ed9e to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302098681e559df29460b915043ed5fc0ed9e 2023-02-09 16:56:33,691 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023020998231501dac04ef780cf8b643fb5e460 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023020998231501dac04ef780cf8b643fb5e460 2023-02-09 16:56:33,692 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302099bea3e8d1eb249738ed5afdf79fece04 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302099bea3e8d1eb249738ed5afdf79fece04 2023-02-09 16:56:33,693 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230209d123888f1c414abe99b13af598aeeef6 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230209d123888f1c414abe99b13af598aeeef6 2023-02-09 16:56:33,693 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-02-09 16:56:33,693 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230209' 2023-02-09 16:56:33,693 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230209 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-09 16:56:33,693 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230209 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-09 16:56:34,537 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-02-09 16:56:34,646 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230209fe53d275dfe6478881a8f5d5cc6b25de to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230209fe53d275dfe6478881a8f5d5cc6b25de 2023-02-09 16:56:34,647 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230209 table='testMajorCompactionFromAdmin' column='family1' 2023-02-09 16:56:34,661 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 16:56:34,661 INFO [MobCompactor-pool-0] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 16:56:34,687 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230209/family1/81d716e6fddd4a6aa496abc51fc8484b first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-02-09 16:56:34,687 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionFromAdmin,1,1675961774139.b6642b7af52cdcee8a7a96045bffa7ab., hostname=jenkins-hbase4.apache.org,35511,1675961620699, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230209/family1/81d716e6fddd4a6aa496abc51fc8484b}] 2023-02-09 16:56:34,689 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.HStore(763): Validating hfile at hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230209/family1/81d716e6fddd4a6aa496abc51fc8484b for inclusion in b6642b7af52cdcee8a7a96045bffa7ab/family1 2023-02-09 16:56:34,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-02-09 16:56:34,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.HStore(777): Region bounds: first=1 last=2 2023-02-09 16:56:34,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.HRegion(2445): Flush status journal for b6642b7af52cdcee8a7a96045bffa7ab: 2023-02-09 16:56:34,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230209/family1/81d716e6fddd4a6aa496abc51fc8484b to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionFromAdmin__mj0vunsrkpsknjeqhbkkvsf3gttq2o6mccnf53tqqiokk6t939f4crr8dlhqikuf/family1/81d716e6fddd4a6aa496abc51fc8484b 2023-02-09 16:56:34,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionFromAdmin__mj0vunsrkpsknjeqhbkkvsf3gttq2o6mccnf53tqqiokk6t939f4crr8dlhqikuf/family1/81d716e6fddd4a6aa496abc51fc8484b as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/family1/818a6c1d4d3046279911af15c05d9171_SeqId_28_ 2023-02-09 16:56:34,712 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.HStore(849): Loaded HFile hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionFromAdmin__mj0vunsrkpsknjeqhbkkvsf3gttq2o6mccnf53tqqiokk6t939f4crr8dlhqikuf/family1/81d716e6fddd4a6aa496abc51fc8484b into b6642b7af52cdcee8a7a96045bffa7ab/family1 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/family1/818a6c1d4d3046279911af15c05d9171_SeqId_28_ - updating store file list. 2023-02-09 16:56:34,736 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.HStore(882): Loaded HFile hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/family1/818a6c1d4d3046279911af15c05d9171_SeqId_28_ into b6642b7af52cdcee8a7a96045bffa7ab/family1 2023-02-09 16:56:34,736 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.HStore(855): Successfully loaded hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionFromAdmin__mj0vunsrkpsknjeqhbkkvsf3gttq2o6mccnf53tqqiokk6t939f4crr8dlhqikuf/family1/81d716e6fddd4a6aa496abc51fc8484b into b6642b7af52cdcee8a7a96045bffa7ab/family1 (new location: hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/family1/818a6c1d4d3046279911af15c05d9171_SeqId_28_) 2023-02-09 16:56:34,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35511] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/staging/jenkins__testMajorCompactionFromAdmin__mj0vunsrkpsknjeqhbkkvsf3gttq2o6mccnf53tqqiokk6t939f4crr8dlhqikuf/family1/81d716e6fddd4a6aa496abc51fc8484b 2023-02-09 16:56:34,738 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230209 table='testMajorCompactionFromAdmin' column='family1' 2023-02-09 16:56:34,739 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 16:56:34,740 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202302091624ad0ff735489abf689307d0c24033 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202302091624ad0ff735489abf689307d0c24033 2023-02-09 16:56:34,741 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023020971bf630baa30404aa3a8e6c2c9b90949 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023020971bf630baa30404aa3a8e6c2c9b90949 2023-02-09 16:56:34,741 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202302098ac0e160835542dc91a14bee2f64c7c8 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202302098ac0e160835542dc91a14bee2f64c7c8 2023-02-09 16:56:34,742 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230209b7db6f1069a24bc09a8ff5b638306376 to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230209b7db6f1069a24bc09a8ff5b638306376 2023-02-09 16:56:34,742 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-02-09 16:56:34,742 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230209' 2023-02-09 16:56:34,742 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230209 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-09 16:56:34,742 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testMajorCompactionFromAdmin' column='family1' 2023-02-09 16:56:34,743 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-09 16:56:34,743 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] compactions.PartitionedMobCompactor(367): [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302093291302d624d4dc48bd88407fc7dfa27_del] 2023-02-09 16:56:34,743 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 16:56:34,744 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302093291302d624d4dc48bd88407fc7dfa27_del to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302093291302d624d4dc48bd88407fc7dfa27_del 2023-02-09 16:56:34,744 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-02-09 16:56:34,744 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] compactions.PartitionedMobCompactor(367): [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023020923cb18279944429597e25dad9e68319c_del] 2023-02-09 16:56:34,744 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 16:56:34,745 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023020923cb18279944429597e25dad9e68319c_del to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023020923cb18279944429597e25dad9e68319c_del 2023-02-09 16:56:34,745 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-02-09 16:56:34,745 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] compactions.PartitionedMobCompactor(367): [hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302093f8d2e21a36243db873ecd13f1ff359c_del] 2023-02-09 16:56:34,746 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 16:56:34,746 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302093f8d2e21a36243db873ecd13f1ff359c_del to hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302093f8d2e21a36243db873ecd13f1ff359c_del 2023-02-09 16:56:34,746 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-02-09 16:56:34,746 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1675961624999] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 16:56:34,748 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=123, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-02-09 16:56:34,749 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=123, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE in 3.2200 sec 2023-02-09 16:56:34,762 DEBUG [Listener at localhost/41619] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-09 16:56:34,764 DEBUG [Listener at localhost/41619] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-09 16:56:34,766 DEBUG [Listener at localhost/41619] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-09 16:56:34,767 DEBUG [Listener at localhost/41619] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-09 16:56:34,771 INFO [Listener at localhost/41619] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 16:56:34,805 INFO [Listener at localhost/41619] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=246 (was 250), OpenFileDescriptor=629 (was 627) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=152 (was 134) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=3127 (was 3133) 2023-02-09 16:56:34,806 DEBUG [Listener at localhost/41619] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x06140021 to 127.0.0.1:53887 2023-02-09 16:56:34,806 DEBUG [Listener at localhost/41619] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 16:56:34,806 INFO [Listener at localhost/41619] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-09 16:56:34,806 INFO [Listener at localhost/41619] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-09 16:56:34,806 DEBUG [Listener at localhost/41619] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6decc8b7 to 127.0.0.1:53887 2023-02-09 16:56:34,807 DEBUG [Listener at localhost/41619] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 16:56:34,807 DEBUG [Listener at localhost/41619] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-09 16:56:34,807 DEBUG [Listener at localhost/41619] util.JVMClusterUtil(257): Found active master hash=570929292, stopped=false 2023-02-09 16:56:34,807 INFO [Listener at localhost/41619] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,41333,1675961619562 2023-02-09 16:56:34,810 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 16:56:34,810 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 16:56:34,810 INFO [Listener at localhost/41619] procedure2.ProcedureExecutor(629): Stopping 2023-02-09 16:56:34,810 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 16:56:34,810 DEBUG [Listener at localhost/41619] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4ec2e9fd to 127.0.0.1:53887 2023-02-09 16:56:34,810 DEBUG [Listener at localhost/41619] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 16:56:34,811 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 16:56:34,811 INFO [Listener at localhost/41619] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,35511,1675961620699' ***** 2023-02-09 16:56:34,811 INFO [Listener at localhost/41619] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-09 16:56:34,811 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 16:56:34,811 INFO [RS:0;jenkins-hbase4:35511] regionserver.HeapMemoryManager(220): Stopping 2023-02-09 16:56:34,811 INFO [RS:0;jenkins-hbase4:35511] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-09 16:56:34,811 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-09 16:56:34,811 INFO [RS:0;jenkins-hbase4:35511] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-09 16:56:34,812 INFO [RS:0;jenkins-hbase4:35511] regionserver.HRegionServer(3304): Received CLOSE for 89b5638a4d4b48414e2d99d1dafde008 2023-02-09 16:56:34,812 INFO [RS:0;jenkins-hbase4:35511] regionserver.HRegionServer(3304): Received CLOSE for ff109ff5b69a09236d8e26cac06ad183 2023-02-09 16:56:34,812 INFO [RS:0;jenkins-hbase4:35511] regionserver.HRegionServer(3304): Received CLOSE for c804397231ed8faa5ea2759a18ad370d 2023-02-09 16:56:34,812 INFO [RS:0;jenkins-hbase4:35511] regionserver.HRegionServer(3304): Received CLOSE for 191a93f3202aa607fa4f5a0c922be433 2023-02-09 16:56:34,812 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 89b5638a4d4b48414e2d99d1dafde008, disabling compactions & flushes 2023-02-09 16:56:34,812 INFO [RS:0;jenkins-hbase4:35511] regionserver.HRegionServer(3304): Received CLOSE for 30e984c82550d4e18563b5c25ccd6237 2023-02-09 16:56:34,812 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,,1675961746226.89b5638a4d4b48414e2d99d1dafde008. 2023-02-09 16:56:34,812 INFO [RS:0;jenkins-hbase4:35511] regionserver.HRegionServer(3304): Received CLOSE for b6642b7af52cdcee8a7a96045bffa7ab 2023-02-09 16:56:34,812 INFO [RS:0;jenkins-hbase4:35511] regionserver.HRegionServer(3304): Received CLOSE for 8f50653056db0fc97159c3a723710554 2023-02-09 16:56:34,812 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,,1675961746226.89b5638a4d4b48414e2d99d1dafde008. 2023-02-09 16:56:34,812 INFO [RS:0;jenkins-hbase4:35511] regionserver.HRegionServer(3304): Received CLOSE for d5ef12f1d65f6f85f477fbd699fd3cf9 2023-02-09 16:56:34,812 INFO [RS:0;jenkins-hbase4:35511] regionserver.HRegionServer(3304): Received CLOSE for 598aece21dfd9476b532637bf96ec2b2 2023-02-09 16:56:34,812 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,,1675961746226.89b5638a4d4b48414e2d99d1dafde008. after waiting 0 ms 2023-02-09 16:56:34,812 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,,1675961746226.89b5638a4d4b48414e2d99d1dafde008. 2023-02-09 16:56:34,812 INFO [RS:0;jenkins-hbase4:35511] regionserver.HRegionServer(3304): Received CLOSE for 95c60abda4725d3b35fe074fbbf00f8f 2023-02-09 16:56:34,812 INFO [RS:0;jenkins-hbase4:35511] regionserver.HRegionServer(3304): Received CLOSE for 964f5813343e8a443a0a9846e8b60a1a 2023-02-09 16:56:34,812 INFO [RS:0;jenkins-hbase4:35511] regionserver.HRegionServer(3304): Received CLOSE for de35d6fbb4adad984ad971174d9fcf25 2023-02-09 16:56:34,812 INFO [RS:0;jenkins-hbase4:35511] regionserver.HRegionServer(3304): Received CLOSE for 3732f079659451c27d92f87ad081fc3c 2023-02-09 16:56:34,812 INFO [RS:0;jenkins-hbase4:35511] regionserver.HRegionServer(3304): Received CLOSE for e502a6fdf571512dee7d1db9a16a0c2f 2023-02-09 16:56:34,812 INFO [RS:0;jenkins-hbase4:35511] regionserver.HRegionServer(3304): Received CLOSE for cb9647e274752929ab251cba8aca91a8 2023-02-09 16:56:34,812 INFO [RS:0;jenkins-hbase4:35511] regionserver.HRegionServer(3304): Received CLOSE for 8c4f1be909138cea70e12c87de376ed7 2023-02-09 16:56:34,812 INFO [RS:0;jenkins-hbase4:35511] regionserver.HRegionServer(3304): Received CLOSE for 42b6e2ba1146417ba4c5be92498b1d58 2023-02-09 16:56:34,812 INFO [RS:0;jenkins-hbase4:35511] regionserver.HRegionServer(3304): Received CLOSE for a74dd38f0f12c6469fa122f81c49c610 2023-02-09 16:56:34,812 INFO [RS:0;jenkins-hbase4:35511] regionserver.HRegionServer(3304): Received CLOSE for e4f991fcac5fe84bc0d9e3454023c242 2023-02-09 16:56:34,813 INFO [RS:0;jenkins-hbase4:35511] regionserver.HRegionServer(3304): Received CLOSE for 372e344ee104159de14194bcc979bbc2 2023-02-09 16:56:34,813 INFO [RS:0;jenkins-hbase4:35511] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:34,813 DEBUG [RS:0;jenkins-hbase4:35511] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x25774c7d to 127.0.0.1:53887 2023-02-09 16:56:34,813 DEBUG [RS:0;jenkins-hbase4:35511] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 16:56:34,813 INFO [RS:0;jenkins-hbase4:35511] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-09 16:56:34,813 INFO [RS:0;jenkins-hbase4:35511] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-09 16:56:34,813 INFO [RS:0;jenkins-hbase4:35511] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-09 16:56:34,813 INFO [RS:0;jenkins-hbase4:35511] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-09 16:56:34,814 INFO [RS:0;jenkins-hbase4:35511] regionserver.HRegionServer(1475): Waiting on 21 regions to close 2023-02-09 16:56:34,814 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-09 16:56:34,814 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-09 16:56:34,814 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-09 16:56:34,814 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-09 16:56:34,814 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-09 16:56:34,814 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=50.56 KB heapSize=78.23 KB 2023-02-09 16:56:34,814 DEBUG [RS:0;jenkins-hbase4:35511] regionserver.HRegionServer(1505): Waiting on 1588230740, 191a93f3202aa607fa4f5a0c922be433, 30e984c82550d4e18563b5c25ccd6237, 372e344ee104159de14194bcc979bbc2, 3732f079659451c27d92f87ad081fc3c, 42b6e2ba1146417ba4c5be92498b1d58, 598aece21dfd9476b532637bf96ec2b2, 89b5638a4d4b48414e2d99d1dafde008, 8c4f1be909138cea70e12c87de376ed7, 8f50653056db0fc97159c3a723710554, 95c60abda4725d3b35fe074fbbf00f8f, 964f5813343e8a443a0a9846e8b60a1a, a74dd38f0f12c6469fa122f81c49c610, b6642b7af52cdcee8a7a96045bffa7ab, c804397231ed8faa5ea2759a18ad370d, cb9647e274752929ab251cba8aca91a8, d5ef12f1d65f6f85f477fbd699fd3cf9, de35d6fbb4adad984ad971174d9fcf25, e4f991fcac5fe84bc0d9e3454023c242, e502a6fdf571512dee7d1db9a16a0c2f, ff109ff5b69a09236d8e26cac06ad183 2023-02-09 16:56:34,816 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/89b5638a4d4b48414e2d99d1dafde008/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-09 16:56:34,817 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed ns:testMinorCompaction,,1675961746226.89b5638a4d4b48414e2d99d1dafde008. 2023-02-09 16:56:34,817 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 89b5638a4d4b48414e2d99d1dafde008: Waiting for close lock at 1675961794812Running coprocessor pre-close hooks at 1675961794812Disabling compacts and flushes for region at 1675961794812Disabling writes for close at 1675961794812Writing region close event to WAL at 1675961794813 (+1 ms)Running coprocessor post-close hooks at 1675961794817 (+4 ms)Closed at 1675961794817 2023-02-09 16:56:34,817 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,,1675961746226.89b5638a4d4b48414e2d99d1dafde008. 2023-02-09 16:56:34,817 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing ff109ff5b69a09236d8e26cac06ad183, disabling compactions & flushes 2023-02-09 16:56:34,817 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,1,1675961720347.ff109ff5b69a09236d8e26cac06ad183. 2023-02-09 16:56:34,817 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1675961720347.ff109ff5b69a09236d8e26cac06ad183. 2023-02-09 16:56:34,818 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,1,1675961720347.ff109ff5b69a09236d8e26cac06ad183. after waiting 0 ms 2023-02-09 16:56:34,818 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,1,1675961720347.ff109ff5b69a09236d8e26cac06ad183. 2023-02-09 16:56:34,822 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/ff109ff5b69a09236d8e26cac06ad183/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-02-09 16:56:34,827 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,1,1675961720347.ff109ff5b69a09236d8e26cac06ad183. 2023-02-09 16:56:34,827 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for ff109ff5b69a09236d8e26cac06ad183: Waiting for close lock at 1675961794817Running coprocessor pre-close hooks at 1675961794817Disabling compacts and flushes for region at 1675961794817Disabling writes for close at 1675961794818 (+1 ms)Writing region close event to WAL at 1675961794819 (+1 ms)Running coprocessor post-close hooks at 1675961794823 (+4 ms)Closed at 1675961794827 (+4 ms) 2023-02-09 16:56:34,827 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,1,1675961720347.ff109ff5b69a09236d8e26cac06ad183. 2023-02-09 16:56:34,827 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing c804397231ed8faa5ea2759a18ad370d, disabling compactions & flushes 2023-02-09 16:56:34,827 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,2,1675961746226.c804397231ed8faa5ea2759a18ad370d. 2023-02-09 16:56:34,827 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,2,1675961746226.c804397231ed8faa5ea2759a18ad370d. 2023-02-09 16:56:34,827 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,2,1675961746226.c804397231ed8faa5ea2759a18ad370d. after waiting 0 ms 2023-02-09 16:56:34,827 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,2,1675961746226.c804397231ed8faa5ea2759a18ad370d. 2023-02-09 16:56:34,830 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/c804397231ed8faa5ea2759a18ad370d/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-09 16:56:34,831 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed ns:testMinorCompaction,2,1675961746226.c804397231ed8faa5ea2759a18ad370d. 2023-02-09 16:56:34,831 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for c804397231ed8faa5ea2759a18ad370d: Waiting for close lock at 1675961794827Running coprocessor pre-close hooks at 1675961794827Disabling compacts and flushes for region at 1675961794827Disabling writes for close at 1675961794827Writing region close event to WAL at 1675961794828 (+1 ms)Running coprocessor post-close hooks at 1675961794831 (+3 ms)Closed at 1675961794831 2023-02-09 16:56:34,831 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,2,1675961746226.c804397231ed8faa5ea2759a18ad370d. 2023-02-09 16:56:34,831 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 191a93f3202aa607fa4f5a0c922be433, disabling compactions & flushes 2023-02-09 16:56:34,831 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithMonthlyPolicy,,1675961640805.191a93f3202aa607fa4f5a0c922be433. 2023-02-09 16:56:34,831 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1675961640805.191a93f3202aa607fa4f5a0c922be433. 2023-02-09 16:56:34,832 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1675961640805.191a93f3202aa607fa4f5a0c922be433. after waiting 1 ms 2023-02-09 16:56:34,832 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1675961640805.191a93f3202aa607fa4f5a0c922be433. 2023-02-09 16:56:34,834 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithMonthlyPolicy/191a93f3202aa607fa4f5a0c922be433/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-02-09 16:56:34,835 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithMonthlyPolicy,,1675961640805.191a93f3202aa607fa4f5a0c922be433. 2023-02-09 16:56:34,835 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 191a93f3202aa607fa4f5a0c922be433: Waiting for close lock at 1675961794831Running coprocessor pre-close hooks at 1675961794831Disabling compacts and flushes for region at 1675961794831Disabling writes for close at 1675961794832 (+1 ms)Writing region close event to WAL at 1675961794832Running coprocessor post-close hooks at 1675961794834 (+2 ms)Closed at 1675961794835 (+1 ms) 2023-02-09 16:56:34,835 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithMonthlyPolicy,,1675961640805.191a93f3202aa607fa4f5a0c922be433. 2023-02-09 16:56:34,835 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 30e984c82550d4e18563b5c25ccd6237, disabling compactions & flushes 2023-02-09 16:56:34,835 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyPolicy,,1675961669674.30e984c82550d4e18563b5c25ccd6237. 2023-02-09 16:56:34,835 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1675961669674.30e984c82550d4e18563b5c25ccd6237. 2023-02-09 16:56:34,835 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1675961669674.30e984c82550d4e18563b5c25ccd6237. after waiting 0 ms 2023-02-09 16:56:34,835 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1675961669674.30e984c82550d4e18563b5c25ccd6237. 2023-02-09 16:56:34,841 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-09 16:56:34,842 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyPolicy/30e984c82550d4e18563b5c25ccd6237/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-02-09 16:56:34,843 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyPolicy,,1675961669674.30e984c82550d4e18563b5c25ccd6237. 2023-02-09 16:56:34,843 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 30e984c82550d4e18563b5c25ccd6237: Waiting for close lock at 1675961794835Running coprocessor pre-close hooks at 1675961794835Disabling compacts and flushes for region at 1675961794835Disabling writes for close at 1675961794835Writing region close event to WAL at 1675961794839 (+4 ms)Running coprocessor post-close hooks at 1675961794842 (+3 ms)Closed at 1675961794843 (+1 ms) 2023-02-09 16:56:34,843 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyPolicy,,1675961669674.30e984c82550d4e18563b5c25ccd6237. 2023-02-09 16:56:34,843 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing b6642b7af52cdcee8a7a96045bffa7ab, disabling compactions & flushes 2023-02-09 16:56:34,843 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,1,1675961774139.b6642b7af52cdcee8a7a96045bffa7ab. 2023-02-09 16:56:34,843 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1675961774139.b6642b7af52cdcee8a7a96045bffa7ab. 2023-02-09 16:56:34,843 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,1,1675961774139.b6642b7af52cdcee8a7a96045bffa7ab. after waiting 0 ms 2023-02-09 16:56:34,843 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,1,1675961774139.b6642b7af52cdcee8a7a96045bffa7ab. 2023-02-09 16:56:34,847 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/b6642b7af52cdcee8a7a96045bffa7ab/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-09 16:56:34,848 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,1,1675961774139.b6642b7af52cdcee8a7a96045bffa7ab. 2023-02-09 16:56:34,848 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for b6642b7af52cdcee8a7a96045bffa7ab: Waiting for close lock at 1675961794843Running coprocessor pre-close hooks at 1675961794843Disabling compacts and flushes for region at 1675961794843Disabling writes for close at 1675961794843Writing region close event to WAL at 1675961794844 (+1 ms)Running coprocessor post-close hooks at 1675961794847 (+3 ms)Closed at 1675961794848 (+1 ms) 2023-02-09 16:56:34,848 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,1,1675961774139.b6642b7af52cdcee8a7a96045bffa7ab. 2023-02-09 16:56:34,848 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 8f50653056db0fc97159c3a723710554, disabling compactions & flushes 2023-02-09 16:56:34,848 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,2,1675961720347.8f50653056db0fc97159c3a723710554. 2023-02-09 16:56:34,848 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1675961720347.8f50653056db0fc97159c3a723710554. 2023-02-09 16:56:34,848 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,2,1675961720347.8f50653056db0fc97159c3a723710554. after waiting 0 ms 2023-02-09 16:56:34,848 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,2,1675961720347.8f50653056db0fc97159c3a723710554. 2023-02-09 16:56:34,851 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/8f50653056db0fc97159c3a723710554/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-02-09 16:56:34,852 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,2,1675961720347.8f50653056db0fc97159c3a723710554. 2023-02-09 16:56:34,852 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 8f50653056db0fc97159c3a723710554: Waiting for close lock at 1675961794848Running coprocessor pre-close hooks at 1675961794848Disabling compacts and flushes for region at 1675961794848Disabling writes for close at 1675961794848Writing region close event to WAL at 1675961794849 (+1 ms)Running coprocessor post-close hooks at 1675961794852 (+3 ms)Closed at 1675961794852 2023-02-09 16:56:34,852 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,2,1675961720347.8f50653056db0fc97159c3a723710554. 2023-02-09 16:56:34,852 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing d5ef12f1d65f6f85f477fbd699fd3cf9, disabling compactions & flushes 2023-02-09 16:56:34,852 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,1,1675961746226.d5ef12f1d65f6f85f477fbd699fd3cf9. 2023-02-09 16:56:34,852 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,1,1675961746226.d5ef12f1d65f6f85f477fbd699fd3cf9. 2023-02-09 16:56:34,852 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,1,1675961746226.d5ef12f1d65f6f85f477fbd699fd3cf9. after waiting 0 ms 2023-02-09 16:56:34,852 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,1,1675961746226.d5ef12f1d65f6f85f477fbd699fd3cf9. 2023-02-09 16:56:34,855 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/ns/testMinorCompaction/d5ef12f1d65f6f85f477fbd699fd3cf9/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-09 16:56:34,856 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed ns:testMinorCompaction,1,1675961746226.d5ef12f1d65f6f85f477fbd699fd3cf9. 2023-02-09 16:56:34,856 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for d5ef12f1d65f6f85f477fbd699fd3cf9: Waiting for close lock at 1675961794852Running coprocessor pre-close hooks at 1675961794852Disabling compacts and flushes for region at 1675961794852Disabling writes for close at 1675961794852Writing region close event to WAL at 1675961794853 (+1 ms)Running coprocessor post-close hooks at 1675961794856 (+3 ms)Closed at 1675961794856 2023-02-09 16:56:34,856 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,1,1675961746226.d5ef12f1d65f6f85f477fbd699fd3cf9. 2023-02-09 16:56:34,856 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 598aece21dfd9476b532637bf96ec2b2, disabling compactions & flushes 2023-02-09 16:56:34,856 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2. 2023-02-09 16:56:34,856 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2. 2023-02-09 16:56:34,857 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2. after waiting 0 ms 2023-02-09 16:56:34,857 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2. 2023-02-09 16:56:34,859 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/598aece21dfd9476b532637bf96ec2b2/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-02-09 16:56:34,860 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2. 2023-02-09 16:56:34,860 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 598aece21dfd9476b532637bf96ec2b2: Waiting for close lock at 1675961794856Running coprocessor pre-close hooks at 1675961794856Disabling compacts and flushes for region at 1675961794856Disabling writes for close at 1675961794857 (+1 ms)Writing region close event to WAL at 1675961794857Running coprocessor post-close hooks at 1675961794859 (+2 ms)Closed at 1675961794860 (+1 ms) 2023-02-09 16:56:34,860 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675961698009.598aece21dfd9476b532637bf96ec2b2. 2023-02-09 16:56:34,860 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 95c60abda4725d3b35fe074fbbf00f8f, disabling compactions & flushes 2023-02-09 16:56:34,860 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675961623590.95c60abda4725d3b35fe074fbbf00f8f. 2023-02-09 16:56:34,860 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675961623590.95c60abda4725d3b35fe074fbbf00f8f. 2023-02-09 16:56:34,860 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675961623590.95c60abda4725d3b35fe074fbbf00f8f. after waiting 0 ms 2023-02-09 16:56:34,860 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675961623590.95c60abda4725d3b35fe074fbbf00f8f. 2023-02-09 16:56:34,860 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 95c60abda4725d3b35fe074fbbf00f8f 1/1 column families, dataSize=109 B heapSize=592 B 2023-02-09 16:56:34,886 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactedHFilesCleaner was stopped 2023-02-09 16:56:35,015 DEBUG [RS:0;jenkins-hbase4:35511] regionserver.HRegionServer(1505): Waiting on 1588230740, 372e344ee104159de14194bcc979bbc2, 3732f079659451c27d92f87ad081fc3c, 42b6e2ba1146417ba4c5be92498b1d58, 8c4f1be909138cea70e12c87de376ed7, 95c60abda4725d3b35fe074fbbf00f8f, 964f5813343e8a443a0a9846e8b60a1a, a74dd38f0f12c6469fa122f81c49c610, cb9647e274752929ab251cba8aca91a8, de35d6fbb4adad984ad971174d9fcf25, e4f991fcac5fe84bc0d9e3454023c242, e502a6fdf571512dee7d1db9a16a0c2f 2023-02-09 16:56:35,215 DEBUG [RS:0;jenkins-hbase4:35511] regionserver.HRegionServer(1505): Waiting on 1588230740, 372e344ee104159de14194bcc979bbc2, 3732f079659451c27d92f87ad081fc3c, 42b6e2ba1146417ba4c5be92498b1d58, 8c4f1be909138cea70e12c87de376ed7, 95c60abda4725d3b35fe074fbbf00f8f, 964f5813343e8a443a0a9846e8b60a1a, a74dd38f0f12c6469fa122f81c49c610, cb9647e274752929ab251cba8aca91a8, de35d6fbb4adad984ad971174d9fcf25, e4f991fcac5fe84bc0d9e3454023c242, e502a6fdf571512dee7d1db9a16a0c2f 2023-02-09 16:56:35,229 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=48.28 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/hbase/meta/1588230740/.tmp/info/68fdafa5119d44e294b8ac35c5434204 2023-02-09 16:56:35,233 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 68fdafa5119d44e294b8ac35c5434204 2023-02-09 16:56:35,247 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-09 16:56:35,247 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-09 16:56:35,267 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=109 B at sequenceid=7 (bloomFilter=true), to=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/hbase/namespace/95c60abda4725d3b35fe074fbbf00f8f/.tmp/info/8ebcffe51dff45e0be5c2ffb42dd2072 2023-02-09 16:56:35,271 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/hbase/namespace/95c60abda4725d3b35fe074fbbf00f8f/.tmp/info/8ebcffe51dff45e0be5c2ffb42dd2072 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/hbase/namespace/95c60abda4725d3b35fe074fbbf00f8f/info/8ebcffe51dff45e0be5c2ffb42dd2072 2023-02-09 16:56:35,275 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/hbase/namespace/95c60abda4725d3b35fe074fbbf00f8f/info/8ebcffe51dff45e0be5c2ffb42dd2072, entries=3, sequenceid=7, filesize=4.8 K 2023-02-09 16:56:35,275 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~109 B/109, heapSize ~576 B/576, currentSize=0 B/0 for 95c60abda4725d3b35fe074fbbf00f8f in 415ms, sequenceid=7, compaction requested=false 2023-02-09 16:56:35,278 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/hbase/namespace/95c60abda4725d3b35fe074fbbf00f8f/recovered.edits/10.seqid, newMaxSeqId=10, maxSeqId=1 2023-02-09 16:56:35,279 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675961623590.95c60abda4725d3b35fe074fbbf00f8f. 2023-02-09 16:56:35,279 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 95c60abda4725d3b35fe074fbbf00f8f: Waiting for close lock at 1675961794860Running coprocessor pre-close hooks at 1675961794860Disabling compacts and flushes for region at 1675961794860Disabling writes for close at 1675961794860Obtaining lock to block concurrent updates at 1675961794860Preparing flush snapshotting stores in 95c60abda4725d3b35fe074fbbf00f8f at 1675961794860Finished memstore snapshotting hbase:namespace,,1675961623590.95c60abda4725d3b35fe074fbbf00f8f., syncing WAL and waiting on mvcc, flushsize=dataSize=109, getHeapSize=576, getOffHeapSize=0, getCellsCount=3 at 1675961794861 (+1 ms)Flushing stores of hbase:namespace,,1675961623590.95c60abda4725d3b35fe074fbbf00f8f. at 1675961794861Flushing 95c60abda4725d3b35fe074fbbf00f8f/info: creating writer at 1675961794861Flushing 95c60abda4725d3b35fe074fbbf00f8f/info: appending metadata at 1675961794863 (+2 ms)Flushing 95c60abda4725d3b35fe074fbbf00f8f/info: closing flushed file at 1675961794863Flushing 95c60abda4725d3b35fe074fbbf00f8f/info: reopening flushed file at 1675961795271 (+408 ms)Finished flush of dataSize ~109 B/109, heapSize ~576 B/576, currentSize=0 B/0 for 95c60abda4725d3b35fe074fbbf00f8f in 415ms, sequenceid=7, compaction requested=false at 1675961795275 (+4 ms)Writing region close event to WAL at 1675961795276 (+1 ms)Running coprocessor post-close hooks at 1675961795279 (+3 ms)Closed at 1675961795279 2023-02-09 16:56:35,280 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1675961623590.95c60abda4725d3b35fe074fbbf00f8f. 2023-02-09 16:56:35,280 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 964f5813343e8a443a0a9846e8b60a1a, disabling compactions & flushes 2023-02-09 16:56:35,280 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,,1675961720347.964f5813343e8a443a0a9846e8b60a1a. 2023-02-09 16:56:35,280 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,,1675961720347.964f5813343e8a443a0a9846e8b60a1a. 2023-02-09 16:56:35,280 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,,1675961720347.964f5813343e8a443a0a9846e8b60a1a. after waiting 0 ms 2023-02-09 16:56:35,280 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,,1675961720347.964f5813343e8a443a0a9846e8b60a1a. 2023-02-09 16:56:35,284 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testCompactionWithHFileLink/964f5813343e8a443a0a9846e8b60a1a/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-02-09 16:56:35,285 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,,1675961720347.964f5813343e8a443a0a9846e8b60a1a. 2023-02-09 16:56:35,285 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 964f5813343e8a443a0a9846e8b60a1a: Waiting for close lock at 1675961795280Running coprocessor pre-close hooks at 1675961795280Disabling compacts and flushes for region at 1675961795280Disabling writes for close at 1675961795280Writing region close event to WAL at 1675961795280Running coprocessor post-close hooks at 1675961795285 (+5 ms)Closed at 1675961795285 2023-02-09 16:56:35,285 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,,1675961720347.964f5813343e8a443a0a9846e8b60a1a. 2023-02-09 16:56:35,285 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing de35d6fbb4adad984ad971174d9fcf25, disabling compactions & flushes 2023-02-09 16:56:35,285 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMinorCompactionWithWeeklyPolicy,,1675961652483.de35d6fbb4adad984ad971174d9fcf25. 2023-02-09 16:56:35,286 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1675961652483.de35d6fbb4adad984ad971174d9fcf25. 2023-02-09 16:56:35,286 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1675961652483.de35d6fbb4adad984ad971174d9fcf25. after waiting 0 ms 2023-02-09 16:56:35,286 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1675961652483.de35d6fbb4adad984ad971174d9fcf25. 2023-02-09 16:56:35,288 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithWeeklyPolicy/de35d6fbb4adad984ad971174d9fcf25/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-02-09 16:56:35,289 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMinorCompactionWithWeeklyPolicy,,1675961652483.de35d6fbb4adad984ad971174d9fcf25. 2023-02-09 16:56:35,289 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for de35d6fbb4adad984ad971174d9fcf25: Waiting for close lock at 1675961795285Running coprocessor pre-close hooks at 1675961795285Disabling compacts and flushes for region at 1675961795285Disabling writes for close at 1675961795286 (+1 ms)Writing region close event to WAL at 1675961795286Running coprocessor post-close hooks at 1675961795288 (+2 ms)Closed at 1675961795289 (+1 ms) 2023-02-09 16:56:35,289 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithWeeklyPolicy,,1675961652483.de35d6fbb4adad984ad971174d9fcf25. 2023-02-09 16:56:35,289 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 3732f079659451c27d92f87ad081fc3c, disabling compactions & flushes 2023-02-09 16:56:35,289 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,2,1675961665479.3732f079659451c27d92f87ad081fc3c. 2023-02-09 16:56:35,289 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1675961665479.3732f079659451c27d92f87ad081fc3c. 2023-02-09 16:56:35,289 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1675961665479.3732f079659451c27d92f87ad081fc3c. after waiting 0 ms 2023-02-09 16:56:35,289 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1675961665479.3732f079659451c27d92f87ad081fc3c. 2023-02-09 16:56:35,292 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testScannerOnBulkLoadRefHFiles/3732f079659451c27d92f87ad081fc3c/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-02-09 16:56:35,293 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,2,1675961665479.3732f079659451c27d92f87ad081fc3c. 2023-02-09 16:56:35,293 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 3732f079659451c27d92f87ad081fc3c: Waiting for close lock at 1675961795289Running coprocessor pre-close hooks at 1675961795289Disabling compacts and flushes for region at 1675961795289Disabling writes for close at 1675961795289Writing region close event to WAL at 1675961795290 (+1 ms)Running coprocessor post-close hooks at 1675961795292 (+2 ms)Closed at 1675961795293 (+1 ms) 2023-02-09 16:56:35,293 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,2,1675961665479.3732f079659451c27d92f87ad081fc3c. 2023-02-09 16:56:35,293 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing e502a6fdf571512dee7d1db9a16a0c2f, disabling compactions & flushes 2023-02-09 16:56:35,293 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1675961625127.e502a6fdf571512dee7d1db9a16a0c2f. 2023-02-09 16:56:35,293 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1675961625127.e502a6fdf571512dee7d1db9a16a0c2f. 2023-02-09 16:56:35,293 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1675961625127.e502a6fdf571512dee7d1db9a16a0c2f. after waiting 0 ms 2023-02-09 16:56:35,293 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1675961625127.e502a6fdf571512dee7d1db9a16a0c2f. 2023-02-09 16:56:35,296 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/e502a6fdf571512dee7d1db9a16a0c2f/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-02-09 16:56:35,296 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1675961625127.e502a6fdf571512dee7d1db9a16a0c2f. 2023-02-09 16:56:35,296 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for e502a6fdf571512dee7d1db9a16a0c2f: Waiting for close lock at 1675961795293Running coprocessor pre-close hooks at 1675961795293Disabling compacts and flushes for region at 1675961795293Disabling writes for close at 1675961795293Writing region close event to WAL at 1675961795294 (+1 ms)Running coprocessor post-close hooks at 1675961795296 (+2 ms)Closed at 1675961795296 2023-02-09 16:56:35,296 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1675961625127.e502a6fdf571512dee7d1db9a16a0c2f. 2023-02-09 16:56:35,297 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing cb9647e274752929ab251cba8aca91a8, disabling compactions & flushes 2023-02-09 16:56:35,297 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,2,1675961774139.cb9647e274752929ab251cba8aca91a8. 2023-02-09 16:56:35,297 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1675961774139.cb9647e274752929ab251cba8aca91a8. 2023-02-09 16:56:35,297 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,2,1675961774139.cb9647e274752929ab251cba8aca91a8. after waiting 0 ms 2023-02-09 16:56:35,297 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,2,1675961774139.cb9647e274752929ab251cba8aca91a8. 2023-02-09 16:56:35,299 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/cb9647e274752929ab251cba8aca91a8/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-09 16:56:35,299 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,2,1675961774139.cb9647e274752929ab251cba8aca91a8. 2023-02-09 16:56:35,300 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for cb9647e274752929ab251cba8aca91a8: Waiting for close lock at 1675961795297Running coprocessor pre-close hooks at 1675961795297Disabling compacts and flushes for region at 1675961795297Disabling writes for close at 1675961795297Writing region close event to WAL at 1675961795297Running coprocessor post-close hooks at 1675961795299 (+2 ms)Closed at 1675961795299 2023-02-09 16:56:35,300 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,2,1675961774139.cb9647e274752929ab251cba8aca91a8. 2023-02-09 16:56:35,300 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 8c4f1be909138cea70e12c87de376ed7, disabling compactions & flushes 2023-02-09 16:56:35,300 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,1,1675961665479.8c4f1be909138cea70e12c87de376ed7. 2023-02-09 16:56:35,300 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1675961665479.8c4f1be909138cea70e12c87de376ed7. 2023-02-09 16:56:35,300 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1675961665479.8c4f1be909138cea70e12c87de376ed7. after waiting 0 ms 2023-02-09 16:56:35,300 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1675961665479.8c4f1be909138cea70e12c87de376ed7. 2023-02-09 16:56:35,302 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testScannerOnBulkLoadRefHFiles/8c4f1be909138cea70e12c87de376ed7/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-09 16:56:35,302 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,1,1675961665479.8c4f1be909138cea70e12c87de376ed7. 2023-02-09 16:56:35,302 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 8c4f1be909138cea70e12c87de376ed7: Waiting for close lock at 1675961795300Running coprocessor pre-close hooks at 1675961795300Disabling compacts and flushes for region at 1675961795300Disabling writes for close at 1675961795300Writing region close event to WAL at 1675961795300Running coprocessor post-close hooks at 1675961795302 (+2 ms)Closed at 1675961795302 2023-02-09 16:56:35,302 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,1,1675961665479.8c4f1be909138cea70e12c87de376ed7. 2023-02-09 16:56:35,302 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 42b6e2ba1146417ba4c5be92498b1d58, disabling compactions & flushes 2023-02-09 16:56:35,302 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,,1675961665479.42b6e2ba1146417ba4c5be92498b1d58. 2023-02-09 16:56:35,302 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1675961665479.42b6e2ba1146417ba4c5be92498b1d58. 2023-02-09 16:56:35,302 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1675961665479.42b6e2ba1146417ba4c5be92498b1d58. after waiting 0 ms 2023-02-09 16:56:35,302 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1675961665479.42b6e2ba1146417ba4c5be92498b1d58. 2023-02-09 16:56:35,304 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testScannerOnBulkLoadRefHFiles/42b6e2ba1146417ba4c5be92498b1d58/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-09 16:56:35,304 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,,1675961665479.42b6e2ba1146417ba4c5be92498b1d58. 2023-02-09 16:56:35,304 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 42b6e2ba1146417ba4c5be92498b1d58: Waiting for close lock at 1675961795302Running coprocessor pre-close hooks at 1675961795302Disabling compacts and flushes for region at 1675961795302Disabling writes for close at 1675961795302Writing region close event to WAL at 1675961795302Running coprocessor post-close hooks at 1675961795304 (+2 ms)Closed at 1675961795304 2023-02-09 16:56:35,304 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,,1675961665479.42b6e2ba1146417ba4c5be92498b1d58. 2023-02-09 16:56:35,305 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing a74dd38f0f12c6469fa122f81c49c610, disabling compactions & flushes 2023-02-09 16:56:35,305 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMinorCompactionWithMonthlyPolicy,,1675961761714.a74dd38f0f12c6469fa122f81c49c610. 2023-02-09 16:56:35,305 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1675961761714.a74dd38f0f12c6469fa122f81c49c610. 2023-02-09 16:56:35,305 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1675961761714.a74dd38f0f12c6469fa122f81c49c610. after waiting 0 ms 2023-02-09 16:56:35,305 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1675961761714.a74dd38f0f12c6469fa122f81c49c610. 2023-02-09 16:56:35,307 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMinorCompactionWithMonthlyPolicy/a74dd38f0f12c6469fa122f81c49c610/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-02-09 16:56:35,307 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMinorCompactionWithMonthlyPolicy,,1675961761714.a74dd38f0f12c6469fa122f81c49c610. 2023-02-09 16:56:35,307 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for a74dd38f0f12c6469fa122f81c49c610: Waiting for close lock at 1675961795305Running coprocessor pre-close hooks at 1675961795305Disabling compacts and flushes for region at 1675961795305Disabling writes for close at 1675961795305Writing region close event to WAL at 1675961795305Running coprocessor post-close hooks at 1675961795307 (+2 ms)Closed at 1675961795307 2023-02-09 16:56:35,307 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithMonthlyPolicy,,1675961761714.a74dd38f0f12c6469fa122f81c49c610. 2023-02-09 16:56:35,307 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing e4f991fcac5fe84bc0d9e3454023c242, disabling compactions & flushes 2023-02-09 16:56:35,307 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242. 2023-02-09 16:56:35,307 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242. 2023-02-09 16:56:35,307 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242. after waiting 0 ms 2023-02-09 16:56:35,307 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242. 2023-02-09 16:56:35,310 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/e4f991fcac5fe84bc0d9e3454023c242/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-02-09 16:56:35,310 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242. 2023-02-09 16:56:35,310 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for e4f991fcac5fe84bc0d9e3454023c242: Waiting for close lock at 1675961795307Running coprocessor pre-close hooks at 1675961795307Disabling compacts and flushes for region at 1675961795307Disabling writes for close at 1675961795307Writing region close event to WAL at 1675961795308 (+1 ms)Running coprocessor post-close hooks at 1675961795310 (+2 ms)Closed at 1675961795310 2023-02-09 16:56:35,310 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675961682120.e4f991fcac5fe84bc0d9e3454023c242. 2023-02-09 16:56:35,310 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 372e344ee104159de14194bcc979bbc2, disabling compactions & flushes 2023-02-09 16:56:35,310 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,,1675961774139.372e344ee104159de14194bcc979bbc2. 2023-02-09 16:56:35,310 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1675961774139.372e344ee104159de14194bcc979bbc2. 2023-02-09 16:56:35,310 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,,1675961774139.372e344ee104159de14194bcc979bbc2. after waiting 0 ms 2023-02-09 16:56:35,311 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,,1675961774139.372e344ee104159de14194bcc979bbc2. 2023-02-09 16:56:35,313 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/default/testMajorCompactionFromAdmin/372e344ee104159de14194bcc979bbc2/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-09 16:56:35,314 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,,1675961774139.372e344ee104159de14194bcc979bbc2. 2023-02-09 16:56:35,314 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 372e344ee104159de14194bcc979bbc2: Waiting for close lock at 1675961795310Running coprocessor pre-close hooks at 1675961795310Disabling compacts and flushes for region at 1675961795310Disabling writes for close at 1675961795310Writing region close event to WAL at 1675961795311 (+1 ms)Running coprocessor post-close hooks at 1675961795314 (+3 ms)Closed at 1675961795314 2023-02-09 16:56:35,314 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,,1675961774139.372e344ee104159de14194bcc979bbc2. 2023-02-09 16:56:35,415 DEBUG [RS:0;jenkins-hbase4:35511] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-09 16:56:35,616 DEBUG [RS:0;jenkins-hbase4:35511] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-09 16:56:35,639 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=102 B at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/hbase/meta/1588230740/.tmp/rep_barrier/9e37ddc68857428a9a6a48697dc99d1b 2023-02-09 16:56:35,643 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9e37ddc68857428a9a6a48697dc99d1b 2023-02-09 16:56:35,775 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-02-09 16:56:35,816 INFO [RS:0;jenkins-hbase4:35511] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-09 16:56:35,816 DEBUG [RS:0;jenkins-hbase4:35511] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-09 16:56:35,816 DEBUG [RS:0;jenkins-hbase4:35511] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-09 16:56:36,016 DEBUG [RS:0;jenkins-hbase4:35511] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-09 16:56:36,049 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.18 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/hbase/meta/1588230740/.tmp/table/bc14c9f8f1614cf392f3b05c33b19242 2023-02-09 16:56:36,053 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bc14c9f8f1614cf392f3b05c33b19242 2023-02-09 16:56:36,053 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/hbase/meta/1588230740/.tmp/info/68fdafa5119d44e294b8ac35c5434204 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/hbase/meta/1588230740/info/68fdafa5119d44e294b8ac35c5434204 2023-02-09 16:56:36,057 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 68fdafa5119d44e294b8ac35c5434204 2023-02-09 16:56:36,057 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/hbase/meta/1588230740/info/68fdafa5119d44e294b8ac35c5434204, entries=226, sequenceid=130, filesize=37.9 K 2023-02-09 16:56:36,058 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/hbase/meta/1588230740/.tmp/rep_barrier/9e37ddc68857428a9a6a48697dc99d1b as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/hbase/meta/1588230740/rep_barrier/9e37ddc68857428a9a6a48697dc99d1b 2023-02-09 16:56:36,061 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9e37ddc68857428a9a6a48697dc99d1b 2023-02-09 16:56:36,061 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/hbase/meta/1588230740/rep_barrier/9e37ddc68857428a9a6a48697dc99d1b, entries=1, sequenceid=130, filesize=5.0 K 2023-02-09 16:56:36,062 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/hbase/meta/1588230740/.tmp/table/bc14c9f8f1614cf392f3b05c33b19242 as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/hbase/meta/1588230740/table/bc14c9f8f1614cf392f3b05c33b19242 2023-02-09 16:56:36,064 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bc14c9f8f1614cf392f3b05c33b19242 2023-02-09 16:56:36,064 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/hbase/meta/1588230740/table/bc14c9f8f1614cf392f3b05c33b19242, entries=27, sequenceid=130, filesize=6.6 K 2023-02-09 16:56:36,066 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~50.56 KB/51772, heapSize ~78.19 KB/80064, currentSize=0 B/0 for 1588230740 in 1252ms, sequenceid=130, compaction requested=false 2023-02-09 16:56:36,070 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/data/hbase/meta/1588230740/recovered.edits/133.seqid, newMaxSeqId=133, maxSeqId=1 2023-02-09 16:56:36,070 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-09 16:56:36,070 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-09 16:56:36,070 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675961794814Running coprocessor pre-close hooks at 1675961794814Disabling compacts and flushes for region at 1675961794814Disabling writes for close at 1675961794814Obtaining lock to block concurrent updates at 1675961794814Preparing flush snapshotting stores in 1588230740 at 1675961794814Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=51772, getHeapSize=80064, getOffHeapSize=0, getCellsCount=365 at 1675961794814Flushing stores of hbase:meta,,1.1588230740 at 1675961794815 (+1 ms)Flushing 1588230740/info: creating writer at 1675961794815Flushing 1588230740/info: appending metadata at 1675961794819 (+4 ms)Flushing 1588230740/info: closing flushed file at 1675961794819Flushing 1588230740/rep_barrier: creating writer at 1675961795233 (+414 ms)Flushing 1588230740/rep_barrier: appending metadata at 1675961795235 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1675961795235Flushing 1588230740/table: creating writer at 1675961795643 (+408 ms)Flushing 1588230740/table: appending metadata at 1675961795645 (+2 ms)Flushing 1588230740/table: closing flushed file at 1675961795645Flushing 1588230740/info: reopening flushed file at 1675961796054 (+409 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1675961796058 (+4 ms)Flushing 1588230740/table: reopening flushed file at 1675961796062 (+4 ms)Finished flush of dataSize ~50.56 KB/51772, heapSize ~78.19 KB/80064, currentSize=0 B/0 for 1588230740 in 1252ms, sequenceid=130, compaction requested=false at 1675961796066 (+4 ms)Writing region close event to WAL at 1675961796068 (+2 ms)Running coprocessor post-close hooks at 1675961796070 (+2 ms)Closed at 1675961796070 2023-02-09 16:56:36,070 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-09 16:56:36,216 INFO [RS:0;jenkins-hbase4:35511] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,35511,1675961620699; all regions closed. 2023-02-09 16:56:36,223 DEBUG [RS:0;jenkins-hbase4:35511] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/oldWALs 2023-02-09 16:56:36,224 INFO [RS:0;jenkins-hbase4:35511] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35511%2C1675961620699.meta:.meta(num 1675961623350) 2023-02-09 16:56:36,227 DEBUG [RS:0;jenkins-hbase4:35511] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/oldWALs 2023-02-09 16:56:36,227 INFO [RS:0;jenkins-hbase4:35511] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35511%2C1675961620699:(num 1675961622394) 2023-02-09 16:56:36,227 DEBUG [RS:0;jenkins-hbase4:35511] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 16:56:36,228 INFO [RS:0;jenkins-hbase4:35511] regionserver.LeaseManager(133): Closed leases 2023-02-09 16:56:36,228 INFO [RS:0;jenkins-hbase4:35511] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-09 16:56:36,228 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 16:56:36,229 INFO [RS:0;jenkins-hbase4:35511] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35511 2023-02-09 16:56:36,237 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35511,1675961620699 2023-02-09 16:56:36,237 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 16:56:36,237 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 16:56:36,237 ERROR [Listener at localhost/41619-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5698ca39 rejected from java.util.concurrent.ThreadPoolExecutor@52a74432[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 533] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 16:56:36,238 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,35511,1675961620699] 2023-02-09 16:56:36,238 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,35511,1675961620699; numProcessing=1 2023-02-09 16:56:36,241 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,35511,1675961620699 already deleted, retry=false 2023-02-09 16:56:36,241 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,35511,1675961620699 expired; onlineServers=0 2023-02-09 16:56:36,241 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,41333,1675961619562' ***** 2023-02-09 16:56:36,241 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-09 16:56:36,241 DEBUG [M:0;jenkins-hbase4:41333] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@633abab7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 16:56:36,242 INFO [M:0;jenkins-hbase4:41333] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,41333,1675961619562 2023-02-09 16:56:36,242 INFO [M:0;jenkins-hbase4:41333] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,41333,1675961619562; all regions closed. 2023-02-09 16:56:36,242 DEBUG [M:0;jenkins-hbase4:41333] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 16:56:36,242 DEBUG [M:0;jenkins-hbase4:41333] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-09 16:56:36,242 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-09 16:56:36,242 DEBUG [M:0;jenkins-hbase4:41333] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-09 16:56:36,242 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675961622101] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675961622101,5,FailOnTimeoutGroup] 2023-02-09 16:56:36,242 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675961622102] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675961622102,5,FailOnTimeoutGroup] 2023-02-09 16:56:36,242 INFO [M:0;jenkins-hbase4:41333] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-09 16:56:36,242 INFO [M:0;jenkins-hbase4:41333] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-09 16:56:36,242 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-09 16:56:36,242 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 16:56:36,242 INFO [M:0;jenkins-hbase4:41333] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-09 16:56:36,243 DEBUG [M:0;jenkins-hbase4:41333] master.HMaster(1502): Stopping service threads 2023-02-09 16:56:36,243 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 16:56:36,243 INFO [M:0;jenkins-hbase4:41333] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-09 16:56:36,243 ERROR [M:0;jenkins-hbase4:41333] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-20,5,PEWorkerGroup] Thread[HFileArchiver-21,5,PEWorkerGroup] Thread[HFileArchiver-22,5,PEWorkerGroup] 2023-02-09 16:56:36,244 INFO [M:0;jenkins-hbase4:41333] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-09 16:56:36,244 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-09 16:56:36,245 DEBUG [M:0;jenkins-hbase4:41333] zookeeper.ZKUtil(398): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-09 16:56:36,245 WARN [M:0;jenkins-hbase4:41333] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-09 16:56:36,245 INFO [M:0;jenkins-hbase4:41333] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-09 16:56:36,245 INFO [M:0;jenkins-hbase4:41333] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-09 16:56:36,245 DEBUG [M:0;jenkins-hbase4:41333] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-09 16:56:36,245 INFO [M:0;jenkins-hbase4:41333] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 16:56:36,245 DEBUG [M:0;jenkins-hbase4:41333] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 16:56:36,245 DEBUG [M:0;jenkins-hbase4:41333] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-09 16:56:36,245 DEBUG [M:0;jenkins-hbase4:41333] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 16:56:36,245 INFO [M:0;jenkins-hbase4:41333] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=512.53 KB heapSize=598.36 KB 2023-02-09 16:56:36,339 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 16:56:36,339 INFO [RS:0;jenkins-hbase4:35511] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,35511,1675961620699; zookeeper connection closed. 2023-02-09 16:56:36,339 ERROR [Listener at localhost/41619-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@36a1d88b rejected from java.util.concurrent.ThreadPoolExecutor@52a74432[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 533] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 16:56:36,339 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): regionserver:35511-0x1003a00baf40001, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 16:56:36,339 ERROR [Listener at localhost/41619-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4e16535d rejected from java.util.concurrent.ThreadPoolExecutor@52a74432[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 533] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 16:56:36,339 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@12137cda] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@12137cda 2023-02-09 16:56:36,339 INFO [Listener at localhost/41619] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-02-09 16:56:36,654 INFO [M:0;jenkins-hbase4:41333] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=512.53 KB at sequenceid=1006 (bloomFilter=true), to=hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/599653bd9130417bbe201caea37dce4e 2023-02-09 16:56:36,657 INFO [M:0;jenkins-hbase4:41333] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 599653bd9130417bbe201caea37dce4e 2023-02-09 16:56:36,658 DEBUG [M:0;jenkins-hbase4:41333] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/599653bd9130417bbe201caea37dce4e as hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/599653bd9130417bbe201caea37dce4e 2023-02-09 16:56:36,661 INFO [M:0;jenkins-hbase4:41333] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 599653bd9130417bbe201caea37dce4e 2023-02-09 16:56:36,661 INFO [M:0;jenkins-hbase4:41333] regionserver.HStore(1080): Added hdfs://localhost:33743/user/jenkins/test-data/0aa77549-b4be-9d0d-dc80-43bae749c5c3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/599653bd9130417bbe201caea37dce4e, entries=123, sequenceid=1006, filesize=33.3 K 2023-02-09 16:56:36,662 INFO [M:0;jenkins-hbase4:41333] regionserver.HRegion(2947): Finished flush of dataSize ~512.53 KB/524835, heapSize ~598.34 KB/612704, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 417ms, sequenceid=1006, compaction requested=false 2023-02-09 16:56:36,662 INFO [M:0;jenkins-hbase4:41333] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 16:56:36,662 DEBUG [M:0;jenkins-hbase4:41333] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675961796245Disabling compacts and flushes for region at 1675961796245Disabling writes for close at 1675961796245Obtaining lock to block concurrent updates at 1675961796246 (+1 ms)Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1675961796246Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=524835, getHeapSize=612704, getOffHeapSize=0, getCellsCount=1161 at 1675961796246Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1675961796246Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1675961796246Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1675961796249 (+3 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1675961796249Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1675961796658 (+409 ms)Finished flush of dataSize ~512.53 KB/524835, heapSize ~598.34 KB/612704, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 417ms, sequenceid=1006, compaction requested=false at 1675961796662 (+4 ms)Writing region close event to WAL at 1675961796662Closed at 1675961796662 2023-02-09 16:56:36,665 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 16:56:36,665 INFO [M:0;jenkins-hbase4:41333] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-09 16:56:36,666 INFO [M:0;jenkins-hbase4:41333] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41333 2023-02-09 16:56:36,668 DEBUG [M:0;jenkins-hbase4:41333] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,41333,1675961619562 already deleted, retry=false 2023-02-09 16:56:36,770 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 16:56:36,770 INFO [M:0;jenkins-hbase4:41333] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,41333,1675961619562; zookeeper connection closed. 2023-02-09 16:56:36,770 ERROR [Listener at localhost/41619-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@d4ec369 rejected from java.util.concurrent.ThreadPoolExecutor@2511bced[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 907] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 16:56:36,770 DEBUG [Listener at localhost/41619-EventThread] zookeeper.ZKWatcher(600): master:41333-0x1003a00baf40000, quorum=127.0.0.1:53887, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 16:56:36,770 ERROR [Listener at localhost/41619-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6de5b655 rejected from java.util.concurrent.ThreadPoolExecutor@2511bced[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 907] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 16:56:36,771 WARN [Listener at localhost/41619] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-09 16:56:36,775 INFO [Listener at localhost/41619] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 16:56:36,882 WARN [BP-1818599261-172.31.14.131-1675961616451 heartbeating to localhost/127.0.0.1:33743] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-09 16:56:36,882 WARN [BP-1818599261-172.31.14.131-1675961616451 heartbeating to localhost/127.0.0.1:33743] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1818599261-172.31.14.131-1675961616451 (Datanode Uuid d193cb00-4901-4ddd-99d7-a366c37b7f50) service to localhost/127.0.0.1:33743 2023-02-09 16:56:36,884 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5698638b-a3fc-8e58-7588-e5d09b0cf064/cluster_d6b3018f-2464-05f6-c84c-1699b67fed18/dfs/data/data1/current/BP-1818599261-172.31.14.131-1675961616451] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 16:56:36,884 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5698638b-a3fc-8e58-7588-e5d09b0cf064/cluster_d6b3018f-2464-05f6-c84c-1699b67fed18/dfs/data/data2/current/BP-1818599261-172.31.14.131-1675961616451] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 16:56:36,913 INFO [Listener at localhost/41619] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 16:56:37,042 INFO [Listener at localhost/41619] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-09 16:56:37,123 INFO [Listener at localhost/41619] hbase.HBaseTestingUtility(1293): Minicluster is down